Forum: Ruby LWP like library for Ruby?

Announcement (2017-05-07): www.ruby-forum.com is now read-only since I unfortunately do not have the time to support and maintain the forum any more. Please see rubyonrails.org/community and ruby-lang.org/en/community for other Rails- und Ruby-related community platforms.
403a239ccedd8d7c07ef5fae23f6adcc?d=identicon&s=25 Robert Nicholson (Guest)
on 2006-05-28 19:53
(Received via mailing list)
Can anybody tell me does Ruby support perl like LWP programming?

ie. scraping content of websites with support for Cookies
Aee77dba395ece0a04c688b05b07cd63?d=identicon&s=25 Daniel Berger (Guest)
on 2006-05-28 20:09
(Received via mailing list)
Robert Nicholson wrote:
> Can anybody tell me does Ruby support perl like LWP programming?
>
> ie. scraping content of websites with support for Cookies
>
>

I believe www-mechanize will do what you want.

Regards,

Dan
19a9e4d07410618284db6a44de12e079?d=identicon&s=25 Xeno Campanoli (Guest)
on 2006-05-29 05:29
(Received via mailing list)
I cannot seem to install www-mechanize using gem install:

>     Could not find www-mechanize (> 0) in the repository
> root@choochoo:~# gem search mechanize
>
> *** LOCAL GEMS ***
> root@choochoo:~#
>

Is it called something different in gems?
19a9e4d07410618284db6a44de12e079?d=identicon&s=25 Xeno Campanoli (Guest)
on 2006-05-29 05:32
(Received via mailing list)
Actually, here is a more interesting failure:

root@choochoo:~# gem install mechanize
Attempting local installation of 'mechanize'
Local gem file not found: mechanize*.gem
Attempting remote installation of 'mechanize'
Install required dependency ruby-web? [Yn]
Successfully installed mechanize-0.4.5
Successfully installed ruby-web-1.1.1
/usr/local/lib/site_ruby/1.8/rubygems/custom_require.rb:21:in
`require__': no such file to load -- rdoc/rdoc (LoadError)
        from
/usr/local/lib/site_ruby/1.8/rubygems/custom_require.rb:21:in `require'
        from /usr/local/lib/site_ruby/1.8/rubygems/doc_manager.rb:43:in
`generate_rdoc'
        from
/usr/local/lib/site_ruby/1.8/rubygems/gem_commands.rb:215:in `execute'
        from
/usr/local/lib/site_ruby/1.8/rubygems/gem_commands.rb:214:in
`each'        from
/usr/local/lib/site_ruby/1.8/rubygems/gem_commands.rb:214:in `execute'
        from
/usr/local/lib/site_ruby/1.8/rubygems/gem_commands.rb:153:in
`each'        from
/usr/local/lib/site_ruby/1.8/rubygems/gem_commands.rb:153:in `execute'
        from /usr/local/lib/site_ruby/1.8/rubygems/command.rb:49:in
`invoke'
        from /usr/local/lib/site_ruby/1.8/rubygems/cmd_manager.rb:94:in
`process_args'
        from /usr/local/lib/site_ruby/1.8/rubygems/cmd_manager.rb:67:in
`run'
        from /usr/local/lib/site_ruby/1.8/rubygems/gem_runner.rb:13:in
`run'
        from /usr/bin/gem:17
root@choochoo:~# which mechanize
root@choochoo:~#
E34b5cae57e0dd170114dba444e37852?d=identicon&s=25 Logan Capaldo (Guest)
on 2006-05-29 08:49
(Received via mailing list)
On May 28, 2006, at 11:29 PM, Xeno Campanoli wrote:

> Actually, here is a more interesting failure:
>
[snip]

Looks like it failed with the installation of the documentation. It's
probably still ok. Note that WWW::Mechanize does not install a binary
like lwp does.

try doing

require 'rubygems'
require 'mechanize'

www = WWW::Mechanize.new
81cf8dab4b4af8aa3148c28421afd845?d=identicon&s=25 Horacio Sanson (Guest)
on 2006-05-29 09:10
(Received via mailing list)
Try HTTPAccess2, it works for me...

http-access2 gives something like the functionality of libwww-perl (LWP)
in
Ruby.

http://raa.ruby-lang.org/project/http-access2/

Horacio

Monday 29 May 2006 15:47ã?Logan Capaldo ã?ã??はæ?¸ãã¾ã?ã?:
This topic is locked and can not be replied to.