What would cause a large spike in my crawl stats? I'm talking from 100 per day avg on my webmaster tools to well over 400 in the last 2-4 days. This has me very worried.
tedster
6:43 pm on Apr 8, 2009 (gmt 0)
If the IP address checks out as being Google for real (reference [webmasterworld.com]), then I would not worry - it could even be a good thing.
Googlebot crawls often show intense spikes and then dips, and that variation has more to do with internal logic and available computing cycles at Google than anything about the sites being crawled.
con771
6:45 pm on Apr 8, 2009 (gmt 0)
I saw these stats in Webmaster Tools when I logged into my crawl stats. I assume these crawl stats are accurate as they are updated by google themselves? Any ideas as to their accuracy?
tedster
7:21 pm on Apr 8, 2009 (gmt 0)
Webmaster Tools are "somewhat" accurate, but they also do get buggy at times. Yes, the stats are maintained by Google.