Forum: Typo Web search and robots

Announcement (2017-05-07): www.ruby-forum.com is now read-only since I unfortunately do not have the time to support and maintain the forum any more. Please see rubyonrails.org/community and ruby-lang.org/en/community for other Rails- und Ruby-related community platforms.
30ee518e6fdc5b07e060775b5a542bdb?d=identicon&s=25 Jón Borgþórsson (jongretar)
on 2006-04-11 12:06
(Received via mailing list)
I was just wondering if a built in support for dynamic robots.txt
files and google sitemaps wouldn't be nice.
I think that dynamically generating google sitemap files would really
help users of typo to get their page out to the masses and controlling
the robots.txt file could reduce load and keep unwanted content of the
search engines. For example there is no need for google to be always
searching the RSS feeds.

Having some control over it in the admin section is something I would
love. How about the rest?


Robots.txt info:
  http://www.robotstxt.org/wc/robots.html
  http://www.pageresource.com/zine/robotstxt.htm
Google Sitemaps info:
  https://www.google.com/webmasters/sitemaps/docs/en...
  https://www.google.com/webmasters/sitemaps/docs/en/faq.html


--
--------------
Jon Gretar Borgthorsson
http://www.jongretar.net/
41f881c6aaa4df224bce5c6f4aea7c35?d=identicon&s=25 Kevin Kubasik (Guest)
on 2006-04-12 05:49
(Received via mailing list)
just for the record i would totaly second and love such a feature.

-Kevin Kubasik

On 4/11/06, Jon Gretar Borgthorsson <jon.borgthorsson@gmail.com> wrote:
>
> --------------
> Jon Gretar Borgthorsson
> http://www.jongretar.net/
>
> _______________________________________________
> Typo-list mailing list
> Typo-list@rubyforge.org
> http://rubyforge.org/mailman/listinfo/typo-list
>


--
Cheers,
Kevin Kubasik
http://blog.kubasik.net/
This topic is locked and can not be replied to.