Hi,
I want to know about authentication in ruby. Is it possible to scrap
html of those sites which require basic authentication.
eg. I want to scrap the profile html page of a user. But in order to get
to that page I need to enter the username and password. Now if I’m using
‘net/http’ to scrap the contents of the profile page, how can I
implement the same. Is it possible in ruby to scrap web pages for which
the user need to enter the username and password.
Please help
N. B. - providing link to any documentation which states this problem
will be really helpfull.
Regards
Arun
2009/5/12 Arun K. [email protected]:
I want to know about authentication in ruby. Is it possible to scrap
html of those sites which require basic authentication.
I am not a native speaker but for all I know “want” is considered
impolite among English speaking people.
N. B. - providing link to any documentation which states this problem
will be really helpfull.
What did your research turn up? Did you check the standard library’s
documentation in the well known place?
Regards
robert
Robert K. wrote:
2009/5/12 Arun K. [email protected]:
� I want to know about authentication in ruby. Is it possible to scrap
html of those sites which require basic authentication.
I am not a native speaker but for all I know “want” is considered
impolite among English speaking people.
N. B. - providing link to any documentation which states this problem
will be really helpfull.
What did your research turn up? Did you check the standard library’s
documentation in the well known place?
Regards
robert
Hi
Thanks for the quick reply. Sorry for the impolite statement.
require ‘net/http’
Net::HTTP.start('www.example.com') {|http|
req = Net::HTTP::Get.new('/secret-page.html')
req.basic_auth 'account', 'password'
response = http.request(req)
print response.body
}
This is the phrase which I got from the ruby-doc site. I dont know
whether this is helpfull or not. That’s why I asked such a doubt. Please
give me a general guidance for this issue.
Thanks
Arun K.
On Tue, May 12, 2009 at 9:06 AM, Arun K.
[email protected] wrote:
 require ‘net/http’
give me a general guidance for this issue.
Well did you try it?
If it didn’t work, did you make the correct substitutions for
‘account’ and ‘password’ ?
–
Rick DeNatale
Blog: http://talklikeaduck.denhaven2.com/
Twitter: http://twitter.com/RickDeNatale
WWR: http://www.workingwithrails.com/person/9021-rick-denatale
LinkedIn: http://www.linkedin.com/in/rickdenatale