LWP like library for Ruby?

Ruby
1

Can anybody tell me does Ruby support perl like LWP programming?

ie. scraping content of websites with support for Cookies

2

Robert N. wrote:

Can anybody tell me does Ruby support perl like LWP programming?

ie. scraping content of websites with support for Cookies

I believe www-mechanize will do what you want.

Regards,

Dan

3

I cannot seem to install www-mechanize using gem install:

Could not find www-mechanize (> 0) in the repository

root@choochoo:~# gem search mechanize

*** LOCAL GEMS ***
root@choochoo:~#

Is it called something different in gems?

4

Actually, here is a more interesting failure:

root@choochoo:~# gem install mechanize
Attempting local installation of ‘mechanize’
Local gem file not found: mechanize*.gem
Attempting remote installation of ‘mechanize’
Install required dependency ruby-web? [Yn]
Successfully installed mechanize-0.4.5
Successfully installed ruby-web-1.1.1
/usr/local/lib/site_ruby/1.8/rubygems/custom_require.rb:21:in
require__': no such file to load -- rdoc/rdoc (LoadError) from /usr/local/lib/site_ruby/1.8/rubygems/custom_require.rb:21:inrequire’
from /usr/local/lib/site_ruby/1.8/rubygems/doc_manager.rb:43:in
generate_rdoc' from /usr/local/lib/site_ruby/1.8/rubygems/gem_commands.rb:215:inexecute’
from
/usr/local/lib/site_ruby/1.8/rubygems/gem_commands.rb:214:in
each' from /usr/local/lib/site_ruby/1.8/rubygems/gem_commands.rb:214:inexecute’
from
/usr/local/lib/site_ruby/1.8/rubygems/gem_commands.rb:153:in
each' from /usr/local/lib/site_ruby/1.8/rubygems/gem_commands.rb:153:inexecute’
from /usr/local/lib/site_ruby/1.8/rubygems/command.rb:49:in
invoke' from /usr/local/lib/site_ruby/1.8/rubygems/cmd_manager.rb:94:inprocess_args’
from /usr/local/lib/site_ruby/1.8/rubygems/cmd_manager.rb:67:in
run' from /usr/local/lib/site_ruby/1.8/rubygems/gem_runner.rb:13:inrun’
from /usr/bin/gem:17
root@choochoo:~# which mechanize
root@choochoo:~#

5

On May 28, 2006, at 11:29 PM, Xeno C. wrote:

Actually, here is a more interesting failure:

[snip]

Looks like it failed with the installation of the documentation. It’s
probably still ok. Note that WWW::Mechanize does not install a binary
like lwp does.

try doing

require ‘rubygems’
require ‘mechanize’

www = WWW::Mechanize.new

6

Try HTTPAccess2, it works for me…

http-access2 gives something like the functionality of libwww-perl (LWP)
in
Ruby.

http://raa.ruby-lang.org/project/http-access2/

Horacio

Monday 29 May 2006 15:47ã?Logan C. ã?ã??はæ?¸ãã¾ã?ã?: