# How to parse rendered html page

**URL:** <https://www.ruby-forum.com/t/how-to-parse-rendered-html-page/182762>\
**Category:** Rails\
**Created:** [February 2, 2010, 2:38pm UTC](https://www.ruby-forum.com/t/how-to-parse-rendered-html-page/182762 "2010-02-02T14:38:55Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![parkurm](https://www.ruby-forum.com/letter_avatar_proxy/v4/letter/p/90db22/32.png) [@parkurm](https://www.ruby-forum.com/u/parkurm)\
**Post date:** [February 2, 2010, 2:38pm UTC](https://www.ruby-forum.com/t/how-to-parse-rendered-html-page/182762/1 "2010-02-02T14:38:55Z")

</div>

I’m trying to write a website that parses all images in a given  
webpage. I initially tried to get all image links by looking for ![]()  
tag, by using nokogiri html parser, and it works well with webpages  
without javascript.

Some pages use javascript to render the view, and using nokogiri, I’m  
just getting raw html results before it’s rendered.

How can I get a page after being rendered by javascript?

---

<div class="post-metadata">

**Author:** ![parkurm](https://www.ruby-forum.com/letter_avatar_proxy/v4/letter/p/90db22/32.png) [@parkurm](https://www.ruby-forum.com/u/parkurm)\
**Post date:** [February 3, 2010, 10:41am UTC](https://www.ruby-forum.com/t/how-to-parse-rendered-html-page/182762/2 "2010-02-03T10:41:19Z")

</div>

You can try with [http://scrubyt.org/index.html](http://scrubyt.org/index.html) that is like mechanize  
but supports javascript.

---

<div class="post-metadata">

**Author:** ![parkurm](https://www.ruby-forum.com/letter_avatar_proxy/v4/letter/p/90db22/32.png) [@parkurm](https://www.ruby-forum.com/u/parkurm)\
**Post date:** [February 2, 2010, 3:42pm UTC](https://www.ruby-forum.com/t/how-to-parse-rendered-html-page/182762/3 "2010-02-02T15:42:53Z")

</div>

parkurm wrote:

> I’m trying to write a website that parses all images in a given  
> webpage. I initially tried to get all image links by looking for ![]()  
> tag, by using nokogiri html parser, and it works well with webpages  
> without javascript.
> 
> Some pages use javascript to render the view, and using nokogiri, I’m  
> just getting raw html results before it’s rendered.
> 
> How can I get a page after being rendered by javascript?

Webrat + Selenium would be one way.

Best,  
–Â  
Marnen Laibow-Koser  
[http://www.marnen.org](http://www.marnen.org)  
removed\_email\_address@domain.invalid
