Welcome to WebmasterWorld Guest from 54.159.50.111

Message Too Old, No Replies

I have not seen Googlebot for 30 days

I have not seen Googlebot for 30 days

     
3:16 pm on Apr 30, 2006 (gmt 0)

Junior Member

10+ Year Member

joined:Nov 7, 2002
posts:75
votes: 0


I have many websites on a server and none of them has seen [google.com...]
in 30 days. I am well indexed in Google and doing well. I did start using a Robot.txt about a month ago. I am not blocking GoogleBot.

Thank you,
Clark

9:37 pm on Apr 30, 2006 (gmt 0)

Senior Member

WebmasterWorld Senior Member tedster is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:May 26, 2000
posts:37301
votes: 0


Big changes in googlebot recently, and also in all Google crawling. You may now be getting visited by other bots that Google operates, such as the AdSense "mediabot" and that crawl is being held in one universal Google cache.

This is what googlebot will put in your site log file
"Googlebot/2.1 (+http://www.google.com/bot.html)"

This is what the adsense spider will leave in your site log file
"Mediapartners-Google/2.1"

In fact, Google's feed spidering and news spidering are now also sharing the same cache with the regular googlebot. See [mattcutts.com...] for more information.