Page is a not externally linkable
- Google
-- Google SEO News and Discussion
---- Google stopped crawling many sites Jun 15 AM


Noton - 6:02 pm on Jun 16, 2010 (gmt 0)


Also remember that ALL the google spiders crawl content for the "googlebot" so please check adsbot if you are buying adwords, which is the other major Googlebot and then check Mediapartners if you are using adsense on the pages. There are several googlebots and other bot names used by Google.

As these bots crawls are then used by googlebot to index content, so googlebot may not be crawling your site more as adsbot and the other google bots have already done the job.

So check your tool that you are using to make sure its monitoring all the google crawls as they are all the same and often should be treated the same within your reporting tools.


Thread source:: http://www.webmasterworld.com/google/4152972.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com