Forum Moderators: martinibuster

Message Too Old, No Replies

AdSense versus GoogleBot Frequency

Joined up, GoogleBot frequency increased same day

         

ronburk

8:42 pm on Sep 13, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I monitored my GoogleBot traffic closely for over six months. Initially, it was only once per month for a "deep crawl". After a couple of months, the "deep crawl" frequency went up to approximately every 14 days.

I joined AdSense a couple of weeks ago, but didn't actually enable it until several days ago. On the same day I enabled AdSense, my GoogleBot frequency of "in-depth" visits greatly increased. Formerly, GoogleBot would take only robots.txt and the root page on a daily basis. As of the day of enabling AdSense, GoogleBot always takes much more than those two (though not yet the entire site in one day). I'm looking at raw logs, so I'm pretty sure I have not confused "Googlebot" with "Mediapartners-Google/2.1".

I've read all the info about how AdSense does not affect GoogleBot, so maybe it's just a striking coincidence. In any case, I'm happy Googlebot is digging deeper more often now.

mipapage

9:37 pm on Sep 14, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Interesting,

I haven't kept up on this theme, however I have a domain that is having trouble getting indexed... perhaps this is worth a try...