Welcome to WebmasterWorld Guest from 54.167.252.62

Message Too Old, No Replies

Big Googlebot Crawling Spike - Update Soon?

     
2:48 am on Aug 30, 2012 (gmt 0)



Noticed a huge spike in Googlebot activity, even higher than early July when the last Panda update came.

Anyone else seeing this? IMHO this is a pretty good early warning signal that a significant update is in the works as every time we've seen this spike it has been followed by a big update.

[i47.tinypic.com ]

In the interest of helping answer questions--

E-Commerce Site
Impacted by first Panda, improved with the past few Panda + Penguins
USA Based
11:37 pm on Sep 13, 2012 (gmt 0)

WebmasterWorld Senior Member 5+ Year Member



Something happened around the 8th of September. Traffic is holding steady, but Zombies out in full force since then... I even lowered my price to almost free and these so called "visitors" won't bite.

I'd call this one the Skunk update.
12:49 am on Sep 14, 2012 (gmt 0)



I'd call this one the Skunk update.


:)))
6:43 am on Sep 14, 2012 (gmt 0)



Magpie surely? Google have taken all the shiny traffic away :(
9:27 am on Sep 16, 2012 (gmt 0)

WebmasterWorld Senior Member zeus is a WebmasterWorld Top Contributor of All Time 10+ Year Member



hmm another big crawl a few days ago, Pages crawled per day almost 10.000, normal 3000, thats the second big crawl in a week. So I had 1 big crawl and 2 very big crawls in 2-3 weeks.
9:30 am on Sep 17, 2012 (gmt 0)



[webmasterworld.com...] this could be the reason for the spike?
11:10 am on Sep 17, 2012 (gmt 0)

WebmasterWorld Senior Member zeus is a WebmasterWorld Top Contributor of All Time 10+ Year Member



kheadley - nah I dont think so, to make such a change I would not think they have to spider a site fully, I think its more a turn on the algo system.
11:16 am on Sep 17, 2012 (gmt 0)



Fair enough was just a thought, quick question all what do you use to track the amount of crawling google has done? I have seen mozcast but would love to see better data.
11:23 am on Sep 17, 2012 (gmt 0)

5+ Year Member



Google Webmaster Tools --> Health --> Crawl Stats
11:26 am on Sep 17, 2012 (gmt 0)



so the stats you are referencing are only on sites that you control? I was assuming that they were general Google stats.
12:00 pm on Sep 17, 2012 (gmt 0)

5+ Year Member



That's right. Only sites that you control.
8:52 am on Sep 21, 2012 (gmt 0)

WebmasterWorld Senior Member zeus is a WebmasterWorld Top Contributor of All Time 10+ Year Member



Well im not sure what I can say to this, but once again I see HUGE peak in pages crawled, my average is 3000, today 11300, so can I look at this as a good thing for the future, well im not sure, but it is unusual, to get such peaks in crawled pages. I hope its a Panda thing, that they crawl the whole site a few times before its released out of Panda, but that is speculations.
12:28 am on Sep 22, 2012 (gmt 0)



I'm seeing a giant spike this past week too. My average is normally 147K, this week 363K.

I'm a Panda 1.0 hit site.
7:22 am on Sep 22, 2012 (gmt 0)

WebmasterWorld Senior Member tedster is a WebmasterWorld Top Contributor of All Time 10+ Year Member



Just an observation - this thread is nearly a month long now, so we're definitely not talking about the same crawling spike that began the thread. In fact, we have seen a Panda Update in between the first post and the most recent.
10:20 am on Sep 22, 2012 (gmt 0)

WebmasterWorld Senior Member zeus is a WebmasterWorld Top Contributor of All Time 10+ Year Member



Well I think this thread is more about those huge crawling hits once a week, first was before update and the last was also before or at update 2, its just unusual for my site. It can also be that those peaks are be cause so many changes is going on, on the site
This 44 message thread spans 2 pages: 44
 

Featured Threads

Hot Threads This Week

Hot Threads This Month