Scrapping Content from a website

Rails
1

Hey all,
I want to scrap some content from a website to rails application and
wants to authenticate the url of the website which I want to scarp so
please help me out…

Thank You!!!

2

I don’t have a lot of experience but did some scraping recently. I
used the nokogiri gem. found it to be pretty self explanatory and
much easier to implement than i had anticipated. google it and i’m
sure you can figure it out…

Max

3

I use Mechanize as user agent and Nokogiri as html/xml parser.
http://mechanize.rubyforge.org/

Mechanize supports both http- and application- layer auth, so that
could be what You are looking for.

4

Hey all,

Hi,

I want to scrap some content from a website to rails application and
wants to authenticate the url of the website which I want to scarp so
please help me out…

Mechanize, Nokogiri , Hpricot.
Some examples in ruby done by me
[Version:1] Easy Dictionary | Sathia's Blog
English to Tamil Translator script | Sathia's Blog
TBus version 1 – Search bus routes from terminal | Sathia's Blog
[update] Foss Job script | Sathia's Blog

–

5

Thanks Dear for the information.