I’m writing a screen scraping application and looking for Ruby
equivalents
of HttpUnit or HttpClient; something that simulates a web browser and
maintains cookies. I’ve taken a look at WebUnit, but it seems to be
poorly
documented and no longer maintained. Is there anything else out there I
might have missed?
Eric
On 2008-01-20 09:00 +0900 (Sun), Eric L. wrote:
I’m writing a screen scraping application and looking for Ruby
equivalents of HttpUnit or HttpClient; something that simulates a web
browser and maintains cookies… Is there anything else out there I
might have missed?
test-httpweb. There’s a rubyforge project for it:
http://rubyforge.org/projects/test-httpweb/
but I’ve not touched that in a while, so it may be slightly stale. The
most recent version (which is probably not all that different) is in the
src subdir of QAM:
http://www.starling-software.com/en/qam.html
In particular, you might find the QAM server stuff helpful; everything
you need for starting up one or more servers (web or otherwise), running
tests against them (using test-httpweb or anything else) and then
tearing it all down again at the end, as well as the scripts you’d use
for starting and stopping staging and production servers, is all there.
A quick look at the tutorial might give you an idea of what’s going on
there, or just write me if you have questions.
cjs
On 2008-01-20 09:00 +0900 (Sun), Eric L. wrote:
I’m writing a screen scraping application and looking for Ruby
equivalents of HttpUnit or HttpClient; something that simulates a web
browser and maintains cookies… Is there anything else out there I
might have missed?
I think waitr is what you’re looking for.
Actually I did a bit of research and found WWW::Mechanize (thought it
was
for Perl only) and scRUBYt, which served my needs quite well. But
thanks
for the need anyways, I’ll look into them!