I’ve got a script that is going through data, and in some cases,
generating md5s of the files. Normally this isn’t a problem, but I’ve
got a few largish (~2G) files in there, and my script is dying on it.
I ran it in a screen so I’m not sure the exact error it threw, but I’m
re-running just that part now to find out. In the meanwhile, any
suggestions?
This is how I’m generating the md5sum right now…
Digest::MD5.hexdigest(File.read(fn))
I’ve got a script that is going through data, and in some cases,
generating md5s of the files. Normally this isn’t a problem, but I’ve
got a few largish (~2G) files in there, and my script is dying on it.
I ran it in a screen so I’m not sure the exact error it threw, but I’m
re-running just that part now to find out. In the meanwhile, any
suggestions?
Thanks both of you. I’d rather not shell out using %x[, but I may end
up doing that. I tried the modified MD5, and it actually ran in close
to the same time on my work machine, have to see how it does against
my home one.