# Spider site script?

**URL:** <https://www.ruby-forum.com/t/spider-site-script/89211>\
**Category:** Rails\
**Created:** [March 18, 2007, 7:30pm UTC](https://www.ruby-forum.com/t/spider-site-script/89211 "2007-03-18T19:30:35Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![scot](https://www.ruby-forum.com/letter_avatar_proxy/v4/letter/s/77aa72/32.png) [@scot](https://www.ruby-forum.com/u/scot)\
**Post date:** [March 18, 2007, 7:30pm UTC](https://www.ruby-forum.com/t/spider-site-script/89211/1 "2007-03-18T19:30:35Z")

</div>

Hi,

Is anyone aware of any scripts that have all ready ben written that will  
spider a given site?

Thanks  
Scot

---

<div class="post-metadata">

**Author:** ![scot](https://www.ruby-forum.com/letter_avatar_proxy/v4/letter/s/77aa72/32.png) [@scot](https://www.ruby-forum.com/u/scot)\
**Post date:** [March 19, 2007, 3:57am UTC](https://www.ruby-forum.com/t/spider-site-script/89211/2 "2007-03-19T03:57:49Z")

</div>

scot wrote:

> Hi,
> 
> Is anyone aware of any scripts that have all ready ben written that will  
> spider a given site?

wget -r ?

–  
Michael W.