Anyone else noticing super low Googlebot activity the last few days? A few weeks ago we saw record high crawling, now the complete opposite with record lows over the last 4 days. Strange stuff.
Planet13
4:59 pm on Sep 17, 2010 (gmt 0)
Actually, over the last few weeks, I have probably been seeing record high googlebot crawling. although that was preceeded by about a week of unusually low crawling.
so it seems like it has been feat or famine lately, while the year or two before that, it was pretty constant.
dvduval
10:28 pm on Sep 17, 2010 (gmt 0)
Am I right in saying that there tends to be variations in activity near the time of a pagerank update? (that has been my experience with limited data)
tedster
10:32 pm on Sep 17, 2010 (gmt 0)
I don't that's the case. As Matt Cutts once said, a PR update is "pretty much a non-event". all they do is export the current PR numbers to the toolbar PR servers - and probably make a few adjustments for those TBPR devaluations we see.
In other words, no number crunching goes into updating toolbar PR so there's no resource drain.
Planet13
12:46 am on Sep 18, 2010 (gmt 0)
Actually, over the last few weeks, I have probably been seeing record high googlebot crawling...
I spoke too soon. googlebot has been nowhere around my sites today...
Lame_Wolf
1:05 am on Sep 18, 2010 (gmt 0)
Am I right in saying that there tends to be variations in activity near the time of a pagerank update? (that has been my experience with limited data)
I do notice the same. And always seems to happen. Okay, I only have a couple of sites, but it always happens. (to me).
SEOPTI
1:58 am on Sep 18, 2010 (gmt 0)
Based on a huge dataset, yes the crawl rate is really slow. I saw the best crawl rate in July.