Forum: Ferret Chinese search support

Announcement (2017-05-07): is now read-only since I unfortunately do not have the time to support and maintain the forum any more. Please see and for other Rails- und Ruby-related community platforms.
Jerry Liu (Guest)
on 2006-02-23 01:32
I need decide on if our site will go with Java or Ruby on Rails. The
major factor is that does Farret support Lucene's ChineseAnalyzer or
CJKAnalyzer or not.

Can anyboby shine some lights on Farret's Chinese search support?

Really appreciate.
David B. (Guest)
on 2006-02-23 08:55
(Received via mailing list)
Hi Jerry,
Basically you'll have to write an analyzer that matches Chinese tokens
(words). If you can write a regular expression in Ruby that matches
Chinese tokens then it's very simple to write an Analyzer for Ferret.
I haven't looked at teh CJKAnalyzer in Lucene but I can't imagine it
would be too hard to port to Ruby.

Erik H. (Guest)
on 2006-02-23 10:20
(Received via mailing list)
There is nothing fancy about the CJKAnalyzer.... it chunks characters
into pairs.  So the phrase 你好� would be tokenized into two
tokens [你好] [好�].

This topic is locked and can not be replied to.