Problem with openUri HTTPError

Rails
#1

Hi, I’m having a issue when attempt to read this page:

http://www.treasury.gov/resource-center/sanctions/SDN-List/Pages/default.aspx

and get the following error:

C:/Ruby187/Ruby1.8.7/lib/ruby/1.8/open-uri.rb:277:in open_http': 500 Internal Server Error (OpenURI::HTTPError) from C:/Ruby187/Ruby1.8.7/lib/ruby/1.8/open-uri.rb:616:inbuffer_open’
from C:/Ruby187/Ruby1.8.7/lib/ruby/1.8/open-uri.rb:164:in
open_loop' from C:/Ruby187/Ruby1.8.7/lib/ruby/1.8/open-uri.rb:162:incatch’
from C:/Ruby187/Ruby1.8.7/lib/ruby/1.8/open-uri.rb:162:in
open_loop' from C:/Ruby187/Ruby1.8.7/lib/ruby/1.8/open-uri.rb:132:inopen_uri’
from C:/Ruby187/Ruby1.8.7/lib/ruby/1.8/open-uri.rb:518:in open' from C:/Ruby187/Ruby1.8.7/lib/ruby/1.8/open-uri.rb:30:inopen’
from prueba_fecha.rb:11

This is the code I’m using

url =
“http://www.treasury.gov/resource-center/sanctions/SDN-List/Pages/default.aspx”
doc = Hpricot(open(url))

Somebody can help me with it?

#2

On Wed, Nov 30, 2011 at 10:29 AM, art tav [email protected] wrote:

Hi, I’m having a issue when attempt to read this page:

http://www.treasury.gov/resource-center/sanctions/SDN-List/Pages/default.aspx

C:/Ruby187/Ruby1.8.7/lib/ruby/1.8/open-uri.rb:277:in `open_http’: 500
Internal Server Error (OpenURI::HTTPError)

Love it. Apparently that server is rather picky about the requests it’s
willing to service :slight_smile: Thank you, Treasury Department!

Anyway, try:

doc = Hpricot(open(url, “User-Agent” => “MSIE”))
=> #<Hpricot::Doc “\r\n” {doctype "<!DOCTYPE html PUBLIC “-//W3C//DTD
XHTML 1.0 Strict//EN” …

Note: this also works :slight_smile:

doc = Hpricot(open(url, “User-Agent” => “Zombies from Space”))

(A look through the open-uri docs will be useful for future reference.)

FWIW,

Hassan S. ------------------------ [email protected]
http://about.me/hassanschroeder
twitter: @hassan

#3

Ohh nice thanks for the help :slight_smile: