Web Scraping

Hi all…

I want to implement the scraping for my rails application.

Any idea???

Thanks…

On Thu, Nov 05, 2009 at 07:34:30AM +0100, Smit S. wrote:

I want to implement the scraping for my rails application.

Rails has nothing to do with scraping, except insofar as it’s serving up
web pages. You should look at the WWW::Mechanize library instead.


“Oh, look: rocks!”
– Doctor Who, “Destiny of the Daleks”

Have a look at ScrAPI. It uses css selectors for scraping and is quite
simple to use.

Ryan B. has done a screencast as well

nas wrote:

Have a look at ScrAPI. It uses css selectors for scraping and is quite
simple to use.

Ryan B. has done a screencast as well
#173 Screen Scraping with ScrAPI - RailsCasts

Thanks for your reply…

I have seen that episode. But what if site have made change in css?
If it will change than I am no longer able to get the data…

Any dynamic solution?