Search_each segmentation fault and parser anomoly

Ruby Apps Ferret
#1

The included test script turned up the following anomolies (run
against Ferret 0.10.3, but had same problems with 0.10.2):

  1. When the content word is not in the index the inclusion of a
    wildcard file term causes search_each to throw a segmentation
    fault.

$ ./test.rb zzz file:.txt
query: +content:zzz +file:.txt
./test.rb:28: [BUG] Segmentation fault
ruby 1.8.4 (2005-12-24) [i486-linux]

Aborted

  1. When the file query term is file:* wildcard the parser
    translates it to +* instead of +file:*

$ ./test.rb one file:*
query: +content:one +*
file: f1.txt

Am I missing something here?

Cheers Stuart

Stuart R.

-----------BEGIN SCRIPT----------------
#!/usr/bin/env ruby

require ‘rubygems’
require ‘ferret’

include Ferret

path = ‘/tmp/test_index’
index = Index::IndexWriter.new(:create => true, :path => path)
index.field_infos.add_field(:file, :store => :yes, :index =>
:untokenized)
index.field_infos.add_field(:content, :store => :no, :index => :yes)

index << {:content => ‘one’, :file => ‘f1.txt’}
index << {:content => ‘two’, :file => ‘f2.txt’}
index << {:content => ‘three’, :file => ‘f3.txt’}
index << {:content => ‘four’, :file => ‘f4.txt’}
index << {:content => ‘five’, :file => ‘f5.txt’}

index.optimize
index.close

query_parser = QueryParser.new({:default_field => :content,
:or_default => false,
})
query = query_parser.parse(ARGV.join(’ '))
puts “query: #{query}”
searcher = Search::Searcher.new(path)
searcher.search_each(query) do |doc, score|
puts “file: #{searcher[doc][:file]}”
end
-------------END SCRIPT----------------

#2

David B. wrote:

Hope that makes sense.

Dave

Yes it does, thanks for the fast response.

Stuart

#3

On 9/9/06, Stuart R. [email protected] wrote:

ruby 1.8.4 (2005-12-24) [i486-linux]

Aborted

Thanks Stuart. This is fixed in subversion. I’ll put another gem out
ASAP.

  1. When the file query term is file:* wildcard the parser
    translates it to +* instead of +file:*

$ ./test.rb one file:*
query: +content:one +*
file: f1.txt

Am I missing something here?

“" matches everything including empty strings. So basically it will
match documents that don’t even contain the :file field. I’ve
therefore optimized it to a MatchAllQuery. Before doing this "” was
pretty much unusable in large indexes since it would create a massive
MultiTermQuery with every term in the index (as long as you set the
:max_clauses parameter of QueryParser large enough to accept them
all).

Now, if you do need to only match documents that contain the desired
field you can do it like this;

$ ./test.rb one file:?*

Hope that makes sense.

Dave