# Advice for html project

**URL:** <https://www.ruby-forum.com/t/advice-for-html-project/191532>\
**Category:** Ruby\
**Created:** [July 14, 2010, 1:38am UTC](https://www.ruby-forum.com/t/advice-for-html-project/191532 "2010-07-14T01:38:28Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![jnb](https://www.ruby-forum.com/letter_avatar_proxy/v4/letter/j/df705f/32.png) [@jnb](https://www.ruby-forum.com/u/jnb)\
**Post date:** [July 14, 2010, 1:38am UTC](https://www.ruby-forum.com/t/advice-for-html-project/191532/1 "2010-07-14T01:38:28Z")

</div>

I helping my boss with some scripting for a web analysis research  
project. He handles vocabulary and analysis, while I am using ruby parse  
WARC files and the actual HTML.

Anyway, I’m still fairly new to Ruby. I did the WARC parsing, but I was  
wondering what I should use for the HTML parser. (Didn’t want to  
re-invent that wheel.) Some considerations:

- Mainly we just need to pull the content text out of the HTML
- A few tags might have special weight or significance (h1, etc.)
- Unfortunately, nearly all the HTML is broken, because all our test  
data was provided by this software that truncates the data after a  
certain length.

---

<div class="post-metadata">

**Author:** ![jnb](https://www.ruby-forum.com/letter_avatar_proxy/v4/letter/j/df705f/32.png) [@jnb](https://www.ruby-forum.com/u/jnb)\
**Post date:** [July 14, 2010, 2:22am UTC](https://www.ruby-forum.com/t/advice-for-html-project/191532/2 "2010-07-14T02:22:47Z")

</div>

Excerpts from Jonathan B.'s message of Wed Jul 14 01:38:31 +0200 2010:

> I helping my boss with some scripting for a web analysis research  
> project. He handles vocabulary and analysis, while I am using ruby parse  
> WARC files and the actual HTML.
> 
> Anyway, I’m still fairly new to Ruby. I did the WARC parsing, but I was  
> wondering what I should use for the HTML parser. (Didn’t want to  
> re-invent that wheel.) Some considerations:  
> Google for nokogiri. That’s one solution.

Marc W.
