I have to develop an application which fetches all the images, pdf, cgi,
etc. file extension links from website.
Can anybody guide me from where should I begin?
I have to develop an application which fetches all the images, pdf, cgi,
etc. file extension links from website.
Can anybody guide me from where should I begin?
You can find usefully information at
Specially Mechanize
[]'s
Felipe Fontoura
Eng. de Computao
http://www.felipefontoura.com
2012/1/4 cyber y. [email protected]
Well wget has a mirror mode that will clone a website
wget --mirror http://www.example.com
or you could look at nutch (Home - NUTCH - Apache Software Foundation) which is a
web crawler for building searches.
This forum is not affiliated to the Ruby language, Ruby on Rails framework, nor any Ruby applications discussed here.
Sponsor our Newsletter | Privacy Policy | Terms of Service | Remote Ruby Jobs