homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Visit PubCon.com
Home / Forums Index / Google / Google SEO News and Discussion
Forum Library, Charter, Moderators: Robert Charlton & aakk9999 & brotherhood of lan & goodroi

Google SEO News and Discussion Forum

Googlebot question for newsites

 12:59 am on Sep 7, 2005 (gmt 0)

I just got my site up and running and created my sitemap for google. What's wierd is that I notice that googlebot is only spidering the following urls:

/blogs/default - My blog page (that I've submitted to some blog sites)

/robots.txt (404)


However it doesn't spider any of the links from sitemap.xml.gz or the ones off of /blogs/default.

Does this make sense for a new site? Should google be following the links off of /blogs/default?



 9:59 am on Sep 13, 2005 (gmt 0)

I have also noticed the same. I put a site up about 3 months ago. After a cople of weeks the home page got indexed. It was only this week that the remaining pages got indexed. Can anyone explain


 10:15 am on Sep 13, 2005 (gmt 0)

It will, eventually, follow the links on your pages. Googlebot makes a note of them and will come back for them when it's bored and has nothing else to do :).

It all depends on how it finds your site (high PR link), and if your site is easily spiderable (is that a word?).

Patience grasshopper.

Global Options:
 top home search open messages active posts  

Home / Forums Index / Google / Google SEO News and Discussion
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved