# Scrape web sites with Mechanize and Hpricot

**URL:** <https://www.ruby-forum.com/t/scrape-web-sites-with-mechanize-and-hpricot/148904>\
**Category:** Rails\
**Created:** [September 18, 2008, 9:00am UTC](https://www.ruby-forum.com/t/scrape-web-sites-with-mechanize-and-hpricot/148904 "2008-09-18T09:00:14Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![David\_Cherner](https://www.ruby-forum.com/letter_avatar_proxy/v4/letter/d/e274bd/32.png) [@David\_Cherner](https://www.ruby-forum.com/u/David_Cherner)\
**Post date:** [September 18, 2008, 9:00am UTC](https://www.ruby-forum.com/t/scrape-web-sites-with-mechanize-and-hpricot/148904/1 "2008-09-18T09:00:14Z")

</div>

Hello,

We are looking for someone to help complete a project, a rails app  
which scrapes job listings from numerous web sites. At this point, the  
bulk of the work to be completed is just telling Mechanize  
how to navigate the web sites and using Hpricot to find 4 fields. The  
contractor must be familiar with Hpricot, Mechanize, and regular  
expressions. There are between 25 and 70 web sites that still need to  
be scraped by Friday, if possible.

Also, It turns out that one of the sites uses javascript and ajax  
heavily so you would need to be able to figure out how to scrape that  
one as well.

Thank you,  
David Cherner