Welcome to WebmasterWorld Guest from

Message Too Old, No Replies

Googlebot question for newsites



12:59 am on Sep 7, 2005 (gmt 0)

10+ Year Member

I just got my site up and running and created my sitemap for google. What's wierd is that I notice that googlebot is only spidering the following urls:

/blogs/default - My blog page (that I've submitted to some blog sites)

/robots.txt (404)


However it doesn't spider any of the links from sitemap.xml.gz or the ones off of /blogs/default.

Does this make sense for a new site? Should google be following the links off of /blogs/default?


9:59 am on Sep 13, 2005 (gmt 0)

10+ Year Member

I have also noticed the same. I put a site up about 3 months ago. After a cople of weeks the home page got indexed. It was only this week that the remaining pages got indexed. Can anyone explain


10:15 am on Sep 13, 2005 (gmt 0)

10+ Year Member

It will, eventually, follow the links on your pages. Googlebot makes a note of them and will come back for them when it's bored and has nothing else to do :).

It all depends on how it finds your site (high PR link), and if your site is easily spiderable (is that a word?).

Patience grasshopper.


Featured Threads

Hot Threads This Week

Hot Threads This Month