Welcome to WebmasterWorld Guest from 18.104.22.168 , register , free tools , login , search , pro membership , help , library , announcements , recent posts , open posts Pubcon Platinum Sponsor 2014
Googlebot going nuts! googlebot trawling lots of pages webplacing
I've just been going through some logs for a client who has a 50 page web site and noticed something a little strange. 3713 accesses by Googlebot. Googlebot does come to this site regularly but never in this volume, recently only requesting 20-40 files a day. Anyone else out there seeing something weird in their logs today?
3713 hits in which time? A month, a week, a day? erthlng
On the 3rd we had a very heavy crawl of 81412 pages for the day. We see a crawl like that from G, about once a month lately. webplacing
Sorry it wasn't clear, in a day. ThomasB
webplacing, do you use sessions? Parameters in the url? have different versions for different browsers/resolutions? Did you check if GB spidered the same sites over and over again? Ferran
My record is 13.000 pages of a domain visited by google in a day, but usually I have 7 or 8 domains visited by google bot 2000 o 3000 times in a day.
With PR3 or PR5, not a really high PR, but linked inside optimized
I've noticed an incredibly increase in Googlebot activity on two totally unrelated sites.
I don't have the numbers in front of me at the moment but they are a lot higher than usual.
Sounds to me like deepbot is back. I'm seeing this behaviour in the logs too.
Wouldn't that be a step backwards to a google of old?
Hi Thomas, The site is a static site, no SSI, no dynamic content, no different versions for browsers or languages, no other domain names pointing at it. Nothing but simple HTML pages, weird huh?