Forum: Typo Web search and robots

Announcement (2017-05-07): is now read-only since I unfortunately do not have the time to support and maintain the forum any more. Please see and for other Rails- und Ruby-related community platforms.
30ee518e6fdc5b07e060775b5a542bdb?d=identicon&s=25 Jón Borgþórsson (jongretar)
on 2006-04-11 12:06
(Received via mailing list)
I was just wondering if a built in support for dynamic robots.txt
files and google sitemaps wouldn't be nice.
I think that dynamically generating google sitemap files would really
help users of typo to get their page out to the masses and controlling
the robots.txt file could reduce load and keep unwanted content of the
search engines. For example there is no need for google to be always
searching the RSS feeds.

Having some control over it in the admin section is something I would
love. How about the rest?

Robots.txt info:
Google Sitemaps info:

Jon Gretar Borgthorsson
41f881c6aaa4df224bce5c6f4aea7c35?d=identicon&s=25 Kevin Kubasik (Guest)
on 2006-04-12 05:49
(Received via mailing list)
just for the record i would totaly second and love such a feature.

-Kevin Kubasik

On 4/11/06, Jon Gretar Borgthorsson <> wrote:
> --------------
> Jon Gretar Borgthorsson
> _______________________________________________
> Typo-list mailing list

Kevin Kubasik
This topic is locked and can not be replied to.