# Scraping

**URL:** <https://www.ruby-forum.com/t/scraping/84092>\
**Category:** Rails\
**Created:** [February 1, 2007, 10:53am UTC](https://www.ruby-forum.com/t/scraping/84092 "2007-02-01T10:53:54Z")\
**Posts on this page:** 6\
**Page:** 1

<div class="post-metadata">

**Author:** ![swanand\_deodhar](https://www.ruby-forum.com/letter_avatar_proxy/v4/letter/s/e36b37/32.png) [@swanand\_deodhar](https://www.ruby-forum.com/u/swanand_deodhar)\
**Post date:** [February 1, 2007, 10:53am UTC](https://www.ruby-forum.com/t/scraping/84092/1 "2007-02-01T10:53:54Z")

</div>

Hi!  
I m new to webscraping but hve rubyful soup in the past. I just wanted  
to  
know tht hw cn i scrape a particular item frm the page instead of  
scraping  
the entire page. E.g Hvng got the URL for a person’s profile can i get  
only  
the name of the person scraped??  
plz help.  
Regards,  
Swanand.

---

<div class="post-metadata">

**Author:** ![swanand\_deodhar](https://www.ruby-forum.com/letter_avatar_proxy/v4/letter/s/e36b37/32.png) [@swanand\_deodhar](https://www.ruby-forum.com/u/swanand_deodhar)\
**Post date:** [February 1, 2007, 10:39pm UTC](https://www.ruby-forum.com/t/scraping/84092/2 "2007-02-01T22:39:17Z")

</div>

On 2/1/07, swanand deodhar [removed\_email\_address@domain.invalid](mailto:removed_email_address@domain.invalid) wrote:

> Hi!  
> I m new to webscraping but hve rubyful soup in the past. I just wanted to  
> know tht hw cn i scrape a particular item frm the page instead of scraping  
> the entire page. E.g Hvng got the URL for a person’s profile can i get only  
> the name of the person scraped??  
> plz help.  
> Regards,  
> Swanand.

Use Hpricot:  
[http://code.whytheluckystiff.net/hpricot/](http://code.whytheluckystiff.net/hpricot/)

–  
Zack C.  
[http://depixelate.com](http://depixelate.com)

---

<div class="post-metadata">

**Author:** ![swanand\_deodhar](https://www.ruby-forum.com/letter_avatar_proxy/v4/letter/s/e36b37/32.png) [@swanand\_deodhar](https://www.ruby-forum.com/u/swanand_deodhar)\
**Post date:** [November 18, 2007, 9:43am UTC](https://www.ruby-forum.com/t/scraping/84092/3 "2007-11-18T09:43:08Z")

</div>

On Nov 17, 8:03 am, venkat [removed\_email\_address@domain.invalid](mailto:removed_email_address@domain.invalid) wrote:

> Is there a library/framework for scraping (web)?
> 
> I have a few scrapers written but would like to see if there are any  
> libraries available. I don’t mean Mechanize and Hpricot or any other  
> parsers for (X)HTML.

If you don’t mean those, what do you mean?

You can always simply fetch the raw page source and run regexps on it.  
Is that more what you mean?

---

<div class="post-metadata">

**Author:** ![swanand\_deodhar](https://www.ruby-forum.com/letter_avatar_proxy/v4/letter/s/e36b37/32.png) [@swanand\_deodhar](https://www.ruby-forum.com/u/swanand_deodhar)\
**Post date:** [November 18, 2007, 5:35pm UTC](https://www.ruby-forum.com/t/scraping/84092/4 "2007-11-18T17:35:37Z")

</div>

You might also like scrAPI  
[http://rubyforge.org/projects/scrapi/](http://rubyforge.org/projects/scrapi/)

-Daniel Brumbaugh K.

---

<div class="post-metadata">

**Author:** ![swanand\_deodhar](https://www.ruby-forum.com/letter_avatar_proxy/v4/letter/s/e36b37/32.png) [@swanand\_deodhar](https://www.ruby-forum.com/u/swanand_deodhar)\
**Post date:** [December 1, 2007, 10:58am UTC](https://www.ruby-forum.com/t/scraping/84092/5 "2007-12-01T10:58:42Z")

</div>

On Nov 16, 9:36 am, venkat \<venkat@\> wrote:

> TIA
> 
> -Venkat

You can check SWExplorerAutomation (SWEA) from [http://webius.net](http://webius.net). SWEA  
separates UI elements binding from the automation script. It makes  
SWEA automation scripts more more resilient to UI changes and  
dramatically decreases time needed for the script maintainance.

---

<div class="post-metadata">

**Author:** ![swanand\_deodhar](https://www.ruby-forum.com/letter_avatar_proxy/v4/letter/s/e36b37/32.png) [@swanand\_deodhar](https://www.ruby-forum.com/u/swanand_deodhar)\
**Post date:** [November 18, 2007, 9:54am UTC](https://www.ruby-forum.com/t/scraping/84092/6 "2007-11-18T09:54:14Z")

</div>

Phrogz wrote:

> On Nov 17, 8:03 am, venkat [removed\_email\_address@domain.invalid](mailto:removed_email_address@domain.invalid) wrote:
> 
> > Is there a library/framework for scraping (web)?

Yeah.

I wrote a little article on this about a year ago, and I almost fell off  
the chair when it was referenced in ‘Learning R.’ from O’Reilly.  
It describes different web scraping possibilities in Ruby:

[http://www.rubyrailways.com/data-extraction-for-web-20-screen-scraping-in-rubyrails](http://www.rubyrailways.com/data-extraction-for-web-20-screen-scraping-in-rubyrails)

Since then I wrote a web scraping framework, scRUBYt! - based on the gem  
download stats (nearly 8000) it’s very popular. It’s also very actively  
developed and … well enough self-advertisement, please read the  
rubyrailways article and decide it for yourself 🙂

Cheers,  
Peter

* * *

[http://www.rubyrailways.com](http://www.rubyrailways.com)  
[http://scrubyt.org](http://scrubyt.org)
