# Extracting web page source

**URL:** <https://www.ruby-forum.com/t/extracting-web-page-source/92008>\
**Category:** Rails\
**Created:** [April 14, 2007, 1:05pm UTC](https://www.ruby-forum.com/t/extracting-web-page-source/92008 "2007-04-14T13:05:14Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![wintermute](https://www.ruby-forum.com/letter_avatar_proxy/v4/letter/w/e19b73/32.png) [@wintermute](https://www.ruby-forum.com/u/wintermute)\
**Post date:** [April 14, 2007, 1:05pm UTC](https://www.ruby-forum.com/t/extracting-web-page-source/92008/1 "2007-04-14T13:05:14Z")

</div>

Hi guys,

I am fairly new to Rails so apologies if this is trivial. I was  
wondering what is the best way to extract a source from a web page?  
Thanks for any help,

W

---

<div class="post-metadata">

**Author:** ![wintermute](https://www.ruby-forum.com/letter_avatar_proxy/v4/letter/w/e19b73/32.png) [@wintermute](https://www.ruby-forum.com/u/wintermute)\
**Post date:** [April 14, 2007, 5:23pm UTC](https://www.ruby-forum.com/t/extracting-web-page-source/92008/2 "2007-04-14T17:23:35Z")

</div>

On Apr 14, 4:04 am, “wintermute” [removed\_email\_address@domain.invalid](mailto:removed_email_address@domain.invalid) wrote:

> Hi guys,
> 
> I am fairly new to Rails so apologies if this is trivial. I was  
> wondering what is the best way to extract a source from a web page?  
> Thanks for any help,
> 
> W

you can use curl or wget to get HTML source and static files  
(CSS, .JS, images) from a web server (or ruby libs like net::HTTP or  
open-uri) , or you can just Control-U in IE or Firefox or Command-U in  
safari to see the source

---

<div class="post-metadata">

**Author:** ![wintermute](https://www.ruby-forum.com/letter_avatar_proxy/v4/letter/w/e19b73/32.png) [@wintermute](https://www.ruby-forum.com/u/wintermute)\
**Post date:** [April 16, 2007, 3:33am UTC](https://www.ruby-forum.com/t/extracting-web-page-source/92008/3 "2007-04-16T03:33:29Z")

</div>

Check out Rubyology’s Screencast #6 Whois. Here they walk you through  
fetching a web page and parsing through the source code for values and  
then returning results based on a condition.

[http://rubyology.com/podcasts/show/10](http://rubyology.com/podcasts/show/10)

---

<div class="post-metadata">

**Author:** ![wintermute](https://www.ruby-forum.com/letter_avatar_proxy/v4/letter/w/e19b73/32.png) [@wintermute](https://www.ruby-forum.com/u/wintermute)\
**Post date:** [April 16, 2007, 4:59am UTC](https://www.ruby-forum.com/t/extracting-web-page-source/92008/4 "2007-04-16T04:59:34Z")

</div>

On Apr 16, 2:32 am, “removed\_email\_address@domain.invalid”  
[removed\_email\_address@domain.invalid](mailto:removed_email_address@domain.invalid) wrote:

> Check out Rubyology’s Screencast #6 Whois. Here they walk you through  
> fetching a web page and parsing through the source code for values and  
> then returning results based on a condition.
> 
> [http://rubyology.com/podcasts/show/10](http://rubyology.com/podcasts/show/10)

That is great stuff thank you both!