Welcome to WebmasterWorld Guest from 54.145.208.64

Forum Moderators: open

Message Too Old, No Replies

Googlebot going nuts!

googlebot trawling lots of pages

   
4:49 pm on Feb 4, 2004 (gmt 0)

10+ Year Member



I've just been going through some logs for a client who has a 50 page web site and noticed something a little strange.
3713 accesses by Googlebot.
Googlebot does come to this site regularly but never in this volume, recently only requesting 20-40 files a day. Anyone else out there seeing something weird in their logs today?
7:59 pm on Feb 4, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



3713 hits in which time? A month, a week, a day?
7:05 am on Feb 5, 2004 (gmt 0)

10+ Year Member



On the 3rd we had a very heavy crawl of 81412 pages for the day. We see a crawl like that from G, about once a month lately.
9:58 am on Feb 5, 2004 (gmt 0)

10+ Year Member



Sorry it wasn't clear, in a day.
11:27 am on Feb 5, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



webplacing, do you use sessions? Parameters in the url? have different versions for different browsers/resolutions? Did you check if GB spidered the same sites over and over again?
12:03 pm on Feb 5, 2004 (gmt 0)

10+ Year Member



My record is 13.000 pages of a domain visited by google in a day, but usually I have 7 or 8 domains visited by google bot 2000 o 3000 times in a day.

With PR3 or PR5, not a really high PR, but linked inside optimized

12:10 pm on Feb 5, 2004 (gmt 0)

10+ Year Member



I've noticed an incredibly increase in Googlebot activity on two totally unrelated sites.

I don't have the numbers in front of me at the moment but they are a lot higher than usual.

3:07 pm on Feb 5, 2004 (gmt 0)

WebmasterWorld Senior Member trillianjedi is a WebmasterWorld Top Contributor of All Time 10+ Year Member



Sounds to me like deepbot is back. I'm seeing this behaviour in the logs too.

Wouldn't that be a step backwards to a google of old?

TJ

5:13 pm on Feb 5, 2004 (gmt 0)

10+ Year Member



Hi Thomas,
The site is a static site, no SSI, no dynamic content, no different versions for browsers or languages, no other domain names pointing at it. Nothing but simple HTML pages, weird huh?