Welcome to WebmasterWorld Guest from

Forum Moderators: Robert Charlton & goodroi

Message Too Old, No Replies

Googlebot question for newsites

12:59 am on Sep 7, 2005 (gmt 0)

New User

10+ Year Member

joined:July 24, 2005
votes: 0

I just got my site up and running and created my sitemap for google. What's wierd is that I notice that googlebot is only spidering the following urls:

/blogs/default - My blog page (that I've submitted to some blog sites)

/robots.txt (404)


However it doesn't spider any of the links from sitemap.xml.gz or the ones off of /blogs/default.

Does this make sense for a new site? Should google be following the links off of /blogs/default?

9:59 am on Sept 13, 2005 (gmt 0)

New User

10+ Year Member

joined:June 28, 2005
votes: 0

I have also noticed the same. I put a site up about 3 months ago. After a cople of weeks the home page got indexed. It was only this week that the remaining pages got indexed. Can anyone explain
10:15 am on Sept 13, 2005 (gmt 0)

Junior Member

10+ Year Member

joined:May 28, 2004
votes: 0

It will, eventually, follow the links on your pages. Googlebot makes a note of them and will come back for them when it's bored and has nothing else to do :).

It all depends on how it finds your site (high PR link), and if your site is easily spiderable (is that a word?).

Patience grasshopper.