Google bots not going beyond front page...

External link a bad idea?

[sosidge]

I've been getting some slightly frustrating behaviour from the Google bots (don't we all).

The last 2 or three times they have come, they have only looked at the front page, never crawling into the site.

This is a pain, because our online shop is within a folder.

I recently put a new front page on the site, which links to our ebay store, as well as linking to our own online shop (the ebay store is the third link, as you read the HTML).

Do you suppose the bots are jumping to the ebay shop, instead of going deeper into our site?

I have no robots.txt file.

[somerset]

Get your site listed in a directory that allows a sitemap to be included. You can then quickly get all your important pages indexed in a flash. Sticky me for more info.

[victor]

Are you using frames?

Is your HTML valid? (the bots may be mis-reading chunks of the page)

Are the internal links dynamic, and if so, do they look like session ids -- ie long random strings? (www.widgets.com/cgi-bin/prog.cgi?page=634623462462462463624)

[sullen]

Is the site new?

With the last couple of sites I've launched, googlebot visited the home page a few times before spidering the whole site. I think the last time it was a few weeks (maybe a month) between the first visit and the first proper visit.

[atlrus]

Yeah, i have the same problem.

My sitemap is visited daily, I have links to my new content on my home page and a few others which are also refreshed daily in google, but my new content is still nowhere to find.

I have no idea why, I guess we just have to wait and see...

[Grogger]

Just posted a separate topic about this ... didn't see this one.

I'm seeing the same issue. Only the homepage getting reindexed. Cache of any other pages are old.

Strange ... but glad I'm not alone.

[john_Max]

This was happend to me also. Don't worry Any time Google bot will visit your all the pages. You should recheck your index page, that there are not bad link.