homepage Welcome to WebmasterWorld Guest from 107.22.37.143
register, free tools, login, search, subscribe, help, library, announcements, recent posts, open posts,
Subscribe and Support WebmasterWorld
Home / Forums Index / Google / Google SEO News and Discussion
Forum Library, Charter, Moderators: Robert Charlton & aakk9999 & brotherhood of lan & goodroi

Google SEO News and Discussion Forum

    
Googlebot Crawling rates way down in September
1script




msg:4491470
 3:38 am on Sep 5, 2012 (gmt 0)

Is this just my sites or somebody else is also seeing this?

Gbot crawling rate started faltering around Aug 28-29th and since Sept. 1st it only goes down on all my sites (as seen via WMT). Some sites are affected more than others but there isn't a single site in the account that has that graph pointing up, and some are down to 20% and less of what was the summer 2012 average.

Traffic hasn't been affected yet but I'm sure it will if the crawling rate keeps dropping like that. Sites are spread across different servers, so it's not a localized network access issue.

Anyone has an opinion on what's going on here?

 

n00b1




msg:4491501
 7:56 am on Sep 5, 2012 (gmt 0)

I have noticed this too. I have added some new content to my site and this would usually be picked up and cached within the day. It has been several days and nothing.

1script




msg:4491741
 3:44 am on Sep 6, 2012 (gmt 0)

It's getting slower still. Pretty much every site in the account is now at the lowest crawl per day since the visible part of the chart began (June 1st 2012)

What's unnerving about these swings is that there isn't a lot that ties the sites in the account together - different types of site, templates, link profiles, ages, niches etc. Just about the only thing that ties them together is me through this one WMT account. Do they dole out crawl budget per WMT account now?

menntarra 34




msg:4492125
 11:38 pm on Sep 6, 2012 (gmt 0)

Same for me, crawl rate is way down...

Sgt_Kickaxe




msg:4492322
 2:35 pm on Sep 7, 2012 (gmt 0)

Confirmed for me too, crawled pages per day is down 50% from pre Aug 30th levels. Something has changed.

Dymero




msg:4492331
 2:58 pm on Sep 7, 2012 (gmt 0)

Mine went down for a few days, but then shot right back up to where it was at the end of August.

serpsup




msg:4492354
 3:37 pm on Sep 7, 2012 (gmt 0)

Mine was down to all time lows for the last week - 10% of previous average. However, it just shot back up to normal today. Maybe it is a reporting error?

Glad to hear it is not just me. I also read that Crawl stats includes Google Image bots and coincidentally my Image traffic just tanked (-60%) in the last day so thought the two were related.

More info on Crawl stats from the Goog: [support.google.com...]

phranque




msg:4492355
 3:37 pm on Sep 7, 2012 (gmt 0)

within the small sample set checked - one that was notably on the high side and the others on the "low end" of normal variation but too early to call it a trend imo.

1script




msg:4492361
 3:47 pm on Sep 7, 2012 (gmt 0)

A complete a pretty dramatic reversal just happened last night: all sites have jumped up considerably and several are at the all times high (since the graph began, now it's around June 5th, 2012).

Could it be that Google's resources have been spent on something else these 5 days? Like a Panda or Penguin recalculations? I wonder if something big is coming ...

johnmoose




msg:4492362
 3:49 pm on Sep 7, 2012 (gmt 0)

Mine went down the first couple of days but is back at the August level right now.

phranque




msg:4492372
 4:18 pm on Sep 7, 2012 (gmt 0)

possibly related to these reports from late august?
Big Googlebot Crawling Spike - Update Soon? - Google SEO News and Discussion forum:
http://www.webmasterworld.com/google/4489654.htm [webmasterworld.com]

1script




msg:4493820
 2:57 pm on Sep 11, 2012 (gmt 0)

Well, the rumors about crawling rate drop reversal have been greatly exaggerated. It's not up so much as it has become simply erratic. After several months of rather smooth crawl rate graph, September looks like a mountain range with peaks and valleys repeating every 3-4 days.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Google / Google SEO News and Discussion
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About
© Webmaster World 1996-2014 all rights reserved