Forum: Ferret End of File Error on index optmize

Announcement (2017-05-07): www.ruby-forum.com is now read-only since I unfortunately do not have the time to support and maintain the forum any more. Please see rubyonrails.org/community and ruby-lang.org/en/community for other Rails- und Ruby-related community platforms.
Erik M. (Guest)
on 2007-06-23 16:45
(Received via mailing list)
I was optimizing a 650MB using ferret (0.11.3) and I received the
following error. I've seen some people have similar issues but I
haven't seen any resolutions. The contents of the index directory
follow the error. Has anyone seen anything like this and found a
resolution? Many thanks.

/mnt/apps/search/releases/20070622175637/script/../config/../vendor/
gems/rdig-0.3.4/lib/rdig/index.rb:48:in `optimize': End-of-File Error
occured at <except.c>:93 in xraise (EOFError)
Error occured in store.c:216 - is_refill
         current pos = 0, file length = 0

         from /mnt/apps/search/releases/20070622175637/script/../
config/../vendor/gems/rdig-0.3.4/lib/rdig/index.rb:48:in `close'
         from /mnt/apps/search/releases/20070622175637/script/../
config/../vendor/gems/rdig-0.3.4/lib/rdig/crawler.rb:36:in `run'
         from /mnt/apps/search/releases/20070622175637/script/../
config/../vendor/gems/rdig-0.3.4/lib/rdig.rb:274:in `run'
         from /mnt/apps/search/releases/20070622175637/script/rdig:95
         from /usr/lib/ruby/gems/1.8/gems/daemons-1.0.5/lib/daemons/
application.rb:152:in `start_load'
         from /usr/lib/ruby/gems/1.8/gems/daemons-1.0.5/lib/daemons/
application.rb:229:in `start'
         from /usr/lib/ruby/gems/1.8/gems/daemons-1.0.5/lib/daemons/
controller.rb:69:in `run'
         from /usr/lib/ruby/gems/1.8/gems/daemons-1.0.5/lib/
daemons.rb:133:in `run'
         from /usr/lib/ruby/gems/1.8/gems/daemons-1.0.5/lib/daemons/
cmdline.rb:105:in `catch_exceptions'
         from /usr/lib/ruby/gems/1.8/gems/daemons-1.0.5/lib/
daemons.rb:132:in `run'

ls -Alh /index_dir/
total 649M
-rw-------  1 my_user my_user 3.2M Jun 22 15:40 _0.cfs
-rw-------  1 my_user my_user  22M Jun 22 17:29 _1.cfs
-rw-------  1 my_user my_user  22M Jun 22 18:53 _2.cfs
-rw-------  1 my_user my_user  23M Jun 22 20:14 _3.cfs
-rw-------  1 my_user my_user  22M Jun 22 22:01 _4.cfs
-rw-------  1 my_user my_user  20M Jun 22 21:19 _5.cfs
-rw-------  1 my_user my_user  41M Jun 22 22:02 _5.fdt
-rw-------  1 my_user my_user 113K Jun 22 22:02 _5.fdx
-rw-------  1 my_user my_user    0 Jun 22 22:02 _5.frq
-rw-------  1 my_user my_user    0 Jun 22 22:02 _5.prx
-rw-------  1 my_user my_user    0 Jun 22 22:02 _5.tfx
-rw-------  1 my_user my_user    0 Jun 22 22:02 _5.tis
-rw-------  1 my_user my_user    0 Jun 22 22:02 _5.tix
-rw-------  1 my_user my_user  57M Jun 22 21:19 _6.fdt
-rw-------  1 my_user my_user 161K Jun 22 21:19 _6.fdx
-rw-------  1 my_user my_user    0 Jun 22 21:19 _6.frq
-rw-------  1 my_user my_user    0 Jun 22 21:19 _6.prx
-rw-------  1 my_user my_user    0 Jun 22 21:19 _6.tfx
-rw-------  1 my_user my_user    0 Jun 22 21:19 _6.tis
-rw-------  1 my_user my_user    0 Jun 22 21:19 _6.tix
-rw-------  1 my_user my_user  22M Jun 22 22:50 _7.cfs
-rw-------  1 my_user my_user 135M Jun 22 22:50 _8.fdt
-rw-------  1 my_user my_user 376K Jun 22 22:50 _8.fdx
-rw-------  1 my_user my_user    0 Jun 22 22:50 _8.frq
-rw-------  1 my_user my_user    0 Jun 22 22:50 _8.prx
-rw-------  1 my_user my_user    0 Jun 22 22:50 _8.tfx
-rw-------  1 my_user my_user    0 Jun 22 22:50 _8.tis
-rw-------  1 my_user my_user    0 Jun 22 22:50 _8.tix
-rw-------  1 my_user my_user 7.9M Jun 22 23:11 _9.cfs
-rw-------  1 my_user my_user 276M Jun 22 23:11 _a.fdt
-rw-------  1 my_user my_user 767K Jun 22 23:11 _a.fdx
-rw-------  1 my_user my_user    0 Jun 22 23:11 _a.frq
-rw-------  1 my_user my_user    0 Jun 22 23:11 _a.prx
-rw-------  1 my_user my_user    0 Jun 22 23:11 _a.tfx
-rw-------  1 my_user my_user    0 Jun 22 23:11 _a.tis
-rw-------  1 my_user my_user    0 Jun 22 23:11 _a.tix
-rw-------  1 my_user my_user   16 Jun 22 23:11 segments
-rw-------  1 my_user my_user  350 Jun 22 23:11 segments_5
Erik M. (Guest)
on 2007-06-23 16:52
(Received via mailing list)
Quick follow up. I'm running a cluster of servers to do indexing in
parallel and I noticed a similar error on another server.

ruby 1.8.4 (2005-12-24) [i386-linux]
Linux  2.6.16-xenU #1 SMP Thu Nov 30 13:48:50 SAST 2006 i686 athlon
i386 GNU/Linux

Over all 16 out of 19 servers have died for as yet unknown reasons.
Here is the other error:

in `optimize': End-of-File Error occured at <except.c>:93 in xraise
(EOFError)
Error occured in compound_io.c:137 - cmpdi_read_i
         Tried to read past end of file. File length is <4360> and
tried to read to <5120>

Help is very much appreciated. Thanks.
Begin forwarded message:
Kyle M. (Guest)
on 2007-06-23 17:22
(Received via mailing list)
> in `optimize': End-of-File Error occured at <except.c>:93 in xraise
> (EOFError)
> Error occured in compound_io.c:137 - cmpdi_read_i
>          Tried to read past end of file. File length is <4360> and
> tried to read to <5120>
> > I was optimizing a 650MB using ferret (0.11.3) and I received the
> > following error. I've seen some people have similar issues but I
> > haven't seen any resolutions. The contents of the index directory
> > follow the error. Has anyone seen anything like this and found a
> > resolution? Many thanks.

Go to ferret 0.11.4

--
Kyle M.
Software Engineer
CastTV, Inc
http://www.casttv.com
This topic is locked and can not be replied to.