Hpricot Html Parsing

Ruby
1

Hi,
I’m getting funky characters, when parsing html using Hpricot.
How to remove this funky character?

Anyone have a fix / workaround for this?

thanks in advance,
Suja

2

Suja JS wrote:

Hi,
I’m getting funky characters, when parsing html using Hpricot.
How to remove this funky character?

Anyone have a fix / workaround for this?

thanks in advance,
Suja

Could you describe these ‘funky characters’?

3

Lee J. wrote:

Suja JS wrote:

Hi,
I’m getting funky characters, when parsing html using Hpricot.
How to remove this funky character?

Anyone have a fix / workaround for this?

thanks in advance,
Suja

Could you describe these ‘funky characters’?

Like ‘�’ in this text.
“By Mike Monson CHAMPAIGN � Effective today the city of Champaign is
closing three bridges and posting load limits on three others.”

4

Hi Suja,

two suggestions:

  • check the encoding used by the page you’re hashpricoting (doh -
    think I just invented a verb, or what).
  • puts $KCODE to see if you’re running in unicode or not. If you are
    hashpricoting a page encoded in UTF-8, but KCODE is set to none (or if
    the page is in latin1, but KCODE is set to U), then you’ll have to
    change the encoding using iconv for instance.

cheers

Thibaut

5

“By Mike Monson CHAMPAIGN ? Effective today the city of Champaign is
closing three bridges and posting load limits on three others.”

hint hint :
http://www.news-gazette.com/news/local/2007/09/14/city_closes_three_bridges_limits_loads

The minus character you see after CHAMPAIGN is not a regular “-”.