Robots.txt protocol support for Ruby

Hi there,

I’m looking for a ruby gem supporting the robots.txt protocol such as
described at:


http://www.robotstxt.org/
http://www.conman.org/people/spc/robots2.html

I’ve found this one:

http://groups.google.com/group/comp.lang.ruby/msg/16f16935bf83c8c6?dmode=source&output=gplain

on comp.lang.ruby but it doesn’t support it totally.
Any other pointer is welcomed.

Cheers,

This forum is not affiliated to the Ruby language, Ruby on Rails framework, nor any Ruby applications discussed here.

| Privacy Policy | Terms of Service | Remote Ruby Jobs