Making a RoR site search index friendly

I’ve added http://guildcorner.org/ to Google about a week ago, and
uploaded a site map (in fact, the site map is dynamic and lists every
character and guild currently registered.)

I’ve seen googlebot hitting the site. It hit every page in my site
map so far. However, according to the webmaster’s tools Google
provides, no pages are indexed. Searching for words that should
certainly make my site appear show this is probably the case.
Searching for site:guildcorner.org returns nothing at all.

Is this perhaps because of caching? I know you cannot really respect
certain http headers (like if-modified-since and expires) easily in a
dynamic site, but I would have thought google would still index what
it could see?

–Michael

I’ve added http://guildcorner.org/ to Google about a week ago, and
uploaded a site map (in fact, the site map is dynamic and lists every
character and guild currently registered.)

Well, right now it’s returning a 500 server error… but i’m guessing it
probably wasn’t…

I’ve seen googlebot hitting the site. It hit every page in my site
map so far. However, according to the webmaster’s tools Google
provides, no pages are indexed. Searching for words that should
certainly make my site appear show this is probably the case.
Searching for site:guildcorner.org returns nothing at all.

Is this perhaps because of caching? I know you cannot really respect
certain http headers (like if-modified-since and expires) easily in a
dynamic site, but I would have thought google would still index what
it could see?

Sign up for the google webmaster tools and see what google thinks of
your
site… there should be some reports in there on what’s indexed, what it
can’t find, etc. etc…

-philip

On 10/25/07, Philip H. [email protected] wrote:

Well, right now it’s returning a 500 server error… but i’m guessing it
probably wasn’t…

That certainly should not be happening. Turns out I forgot the flag
to delete associated records. :confused: Fixed now.

Sign up for the google webmaster tools and see what google thinks of your
site… there should be some reports in there on what’s indexed, what it
can’t find, etc. etc…

That’s the problem – it says no pages are indexed. No stats at all.
Just … nothing.

–Michael

Michael G. wrote:

Is this perhaps because of caching? I know you cannot really respect
certain http headers (like if-modified-since and expires) easily in a
dynamic site, but I would have thought google would still index what
it could see?

–Michael

It takes a while for new sites to get added to Google’s actual index
after they are submitted and spidered. It took mine several weeks to
start showing up. Even more than that, there is some talk of a sandbox
that keeps your site from showing up in top search results for a few
months at least. It is a protection against spam sites.

Just be patient and your site will eventually show up. :slight_smile: