Can Google (et. al.) see rails pages?

Hi,
Noob here.

One problem faced by developers of active content is making sure that
the final results of their magic result in URL’s that Google and other
search engines are comfortable with. Otherwise, your content won’t ever
get spydered and indexed and ultimately returned in a google user’s
results pages.

In reading the agile rails book, it seems that the URL’s are all simply
the name of a controller, with no extension to tell a spyder or search
engine what kind of content that URL will serve up – “.html”, or
“.php”, or anything else that a spyder would be comfortable with.

That being the case, are there ways to change how its written, or
redirection tricks, or some other way to make a dynamic rails site
deliver pages that search engines will index?

thanks,
jp

On 1/22/06, Jeff P. [email protected] wrote:

Hi,
Noob here.

One problem faced by developers of active content is making sure that
the final results of their magic result in URL’s that Google and other
search engines are comfortable with. Otherwise, your content won’t ever
get spydered and indexed and ultimately returned in a google user’s
results pages.

Google doesn’t have a problem indexing rails sites, but I"m unsure
about the other engines. If you’re really worried about it, I think
you could to same magic in your routes.rb files to get .html
extensions. Not sure about that - I’ve never tried it.

On Monday 23 Jan 2006 04:02, Jeff P. wrote:

One problem faced by developers of active content is making sure that
the final results of their magic result in URL’s that Google and other
search engines are comfortable with. Otherwise, your content won’t ever
get spydered and indexed and ultimately returned in a google user’s
results pages.

Just think of all those ugly JSP and ASP “short novel” URLs that get
indexed
no problem - Rails URLs are a work of art by comparison. :slight_smile:

In reading the agile rails book, it seems that the URL’s are all simply
the name of a controller, with no extension to tell a spyder or search
engine what kind of content that URL will serve up – “.html”, or
“.php”, or anything else that a spyder would be comfortable with.

That’s what the MIME type is for - only really old / broken user agents
depend
on the file extension to work out what the content is.

You could theoretically serve your pages with the extension “.doc” or
“.somerandomextensionthatimadeup”, or even no extension at all - as long
as
you set the MIME type correctly in the headers it will work great.

In fact, I’m sure some future RFC recommended not using file extensions
at all
for anything (not even for images), though my Google-fu isn’t so great
at
this time of night that I can actually find it.

That being the case, are there ways to change how its written, or
redirection tricks, or some other way to make a dynamic rails site
deliver pages that search engines will index?

The search engines will try to access each URL as if it were the root of
a
directory (so you know from back in the old days of “my first website”
when
you go to “/” and actually you’re seeing “index.html”), and thanks to
the
MIME type will recognise that it’s a HTML page.

“If it ain’t broke, don’t fix it”… this is a non-problem, so don’t
worry
about it, everything will work just fine as it is! :slight_smile:

Cheers,

~Dave

Dave S.
Rent-A-Monkey Website Development

PGP Key: http://www.rentamonkey.com/pgpkey.asc

Dave S. wrote:

“If it ain’t broke, don’t fix it”… this is a non-problem, so don’t
worry
about it, everything will work just fine as it is! :slight_smile:

Cheers,

~Dave

Cool. It’s an interesting thing about technology. None of what you
learn has a “freshness date” on it. There’s no way to know if you’re
really smart because you’ve been learning this stuff for a long time, or
really stupid because most of what you know ceased to be true yesterday
(or in this case maybe a couple years ago).

thanks,
jp