Welcome to WebmasterWorld Guest from 54.158.55.251

Forum Moderators: Robert Charlton & andy langton & goodroi

Message Too Old, No Replies

Big Googlebot Crawling Spike - Update Soon?

     
2:48 am on Aug 30, 2012 (gmt 0)

New User

5+ Year Member

joined:Feb 28, 2011
posts:29
votes: 0


Noticed a huge spike in Googlebot activity, even higher than early July when the last Panda update came.

Anyone else seeing this? IMHO this is a pretty good early warning signal that a significant update is in the works as every time we've seen this spike it has been followed by a big update.

[i47.tinypic.com ]

In the interest of helping answer questions--

E-Commerce Site
Impacted by first Panda, improved with the past few Panda + Penguins
USA Based
11:37 pm on Sept 13, 2012 (gmt 0)

Senior Member

WebmasterWorld Senior Member 5+ Year Member

joined:Mar 4, 2010
posts:1302
votes: 0


Something happened around the 8th of September. Traffic is holding steady, but Zombies out in full force since then... I even lowered my price to almost free and these so called "visitors" won't bite.

I'd call this one the Skunk update.
12:49 am on Sept 14, 2012 (gmt 0)

Junior Member

joined:Sept 1, 2012
posts: 186
votes: 0


I'd call this one the Skunk update.


:)))
6:43 am on Sept 14, 2012 (gmt 0)

Senior Member

joined:May 13, 2010
posts: 1054
votes: 0


Magpie surely? Google have taken all the shiny traffic away :(
9:27 am on Sept 16, 2012 (gmt 0)

Senior Member

WebmasterWorld Senior Member zeus is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:Apr 28, 2002
posts:3444
votes: 1


hmm another big crawl a few days ago, Pages crawled per day almost 10.000, normal 3000, thats the second big crawl in a week. So I had 1 big crawl and 2 very big crawls in 2-3 weeks.
9:30 am on Sept 17, 2012 (gmt 0)

New User

joined:Aug 23, 2012
posts: 21
votes: 0


[webmasterworld.com...] this could be the reason for the spike?
11:10 am on Sept 17, 2012 (gmt 0)

Senior Member

WebmasterWorld Senior Member zeus is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:Apr 28, 2002
posts:3444
votes: 1


kheadley - nah I dont think so, to make such a change I would not think they have to spider a site fully, I think its more a turn on the algo system.
11:16 am on Sept 17, 2012 (gmt 0)

New User

joined:Aug 23, 2012
posts: 21
votes: 0


Fair enough was just a thought, quick question all what do you use to track the amount of crawling google has done? I have seen mozcast but would love to see better data.
11:23 am on Sept 17, 2012 (gmt 0)

Junior Member

5+ Year Member

joined:July 13, 2009
posts: 61
votes: 0


Google Webmaster Tools --> Health --> Crawl Stats
11:26 am on Sept 17, 2012 (gmt 0)

New User

joined:Aug 23, 2012
posts: 21
votes: 0


so the stats you are referencing are only on sites that you control? I was assuming that they were general Google stats.
12:00 pm on Sept 17, 2012 (gmt 0)

Junior Member

5+ Year Member

joined:July 13, 2009
posts: 61
votes: 0


That's right. Only sites that you control.
8:52 am on Sept 21, 2012 (gmt 0)

Senior Member

WebmasterWorld Senior Member zeus is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:Apr 28, 2002
posts:3444
votes: 1


Well im not sure what I can say to this, but once again I see HUGE peak in pages crawled, my average is 3000, today 11300, so can I look at this as a good thing for the future, well im not sure, but it is unusual, to get such peaks in crawled pages. I hope its a Panda thing, that they crawl the whole site a few times before its released out of Panda, but that is speculations.
12:28 am on Sept 22, 2012 (gmt 0)

New User

5+ Year Member

joined:Aug 18, 2011
posts:26
votes: 0


I'm seeing a giant spike this past week too. My average is normally 147K, this week 363K.

I'm a Panda 1.0 hit site.
7:22 am on Sept 22, 2012 (gmt 0)

Senior Member

WebmasterWorld Senior Member tedster is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:May 26, 2000
posts:37301
votes: 0


Just an observation - this thread is nearly a month long now, so we're definitely not talking about the same crawling spike that began the thread. In fact, we have seen a Panda Update in between the first post and the most recent.
10:20 am on Sept 22, 2012 (gmt 0)

Senior Member

WebmasterWorld Senior Member zeus is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:Apr 28, 2002
posts:3444
votes: 1


Well I think this thread is more about those huge crawling hits once a week, first was before update and the last was also before or at update 2, its just unusual for my site. It can also be that those peaks are be cause so many changes is going on, on the site
This 44 message thread spans 2 pages: 44
 

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members