Forum Moderators: buckworks

Message Too Old, No Replies

High amount of crawling from googlebot?

         

olimits7

3:17 pm on Jul 5, 2011 (gmt 0)

10+ Year Member



Hi,

Lately, I've been noticing a high amount of crawling from googlebot on my site; around 45+ instances of googlebot. Once it finishes googlebot drops off my site, but then a couple days later I notice around 45+ instances again.

Do you guys notice the same thing on your site from googlebot?

Is this a good thing or should I limit how often google crawls my site?

Thank you,

olimits7

dpd1

9:56 pm on Jul 7, 2011 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I noticed they are getting very efficient lately. I've seen posts I made on forums come up in searches a few hours later. It blew me away. I was like... Oh, here's some info... Oh wait, that was me. lol

As long as it doesn't hurt anything, I wouldn't mess with anything they do... God only knows what effect it would have.

olimits7

3:33 am on Jul 8, 2011 (gmt 0)

10+ Year Member



Hahaha...I noticed the same thing I did a search for this same topic on Google soon after I posted it and I thought the same thing.

I was like, great, there is some info out there on this and then I realized it was me...haha.

lucy24

5:19 am on Jul 8, 2011 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Google absolutely adores the WebmasterWorld forums. If only they gave half as much time to our own sites :(

pogodan

3:45 pm on Jul 10, 2011 (gmt 0)

10+ Year Member



If googlebot is generating so much traffic it's slowing down the site for other users, you should rate-limit it. You can actually do that by signing in to Google's webmaster tools and changing the crawl rate for your site: [google.com...]