Ferret doesn't work with Luke

Ruby Apps Ferret
1

Hi,

Does anyone know why the indexes created by Ferret can’t be opened by
Luke (http://www.getopt.org/luke/)? When I do development with Clucene I
use Luke all the time to understand what is going on in the index. It is
especially useful when trying to diagnose analyzer issues.

When I try to open a Ferret index with Luke I get the message “Invalid
or corrupted index”. I thought that Ferret used Lucene’s file format and
so Luke should be able to open them.

Thanks,

Chris Waters

2

I believe Ferret has diverged from Lucene to the point that their
indexes are not compatible. ferret-browser, included in the latest
Ferret gems, may display some of the same information as Luke.

-Stuart Sierra

3

Thanks. Ferret-browser is exactly what I needed.

Any idea where the index formats diverged? It is a pity because it
removes the ability to use a much larger set of tools for managing
Ferret indexes, and also the possibility of writing tools in ruby to
manipulate lucene indexes.

Regards,

Chris.

4

On Wed, Jul 18, 2007 at 07:00:49PM -0400, Waters, Chris wrote:

Thanks. Ferret-browser is exactly what I needed.

Any idea where the index formats diverged? It is a pity because it
removes the ability to use a much larger set of tools for managing
Ferret indexes, and also the possibility of writing tools in ruby to
manipulate lucene indexes.

afaik problems started with UTF8 content, which Java serializes in a way
different from the rest of the world. Then Dave decided to give up on
index compatibility since it was useless for everybody not only storing
ASCII content anyway and made changes to the index format to enhance
performance and ease the implementation of some features, but I’m not
sure what or when exactly this was.

The ml archive could be of help to find out more.

cheers,
Jens

–
Jens Krämer
webit! Gesellschaft für neue Medien mbH
Schnorrstraße 76 | 01069 Dresden
Telefon +49 351 46766-0 | Telefax +49 351 46766-66
[email protected] | www.webit.de

Amtsgericht Dresden | HRB 15422
GF Sven Haubold, Hagen Malessa