Welcome to WebmasterWorld Guest from 54.226.246.160

Forum Moderators: open

Message Too Old, No Replies

Googlebot going nuts!

googlebot trawling lots of pages

     

webplacing

4:49 pm on Feb 4, 2004 (gmt 0)

10+ Year Member



I've just been going through some logs for a client who has a 50 page web site and noticed something a little strange.
3713 accesses by Googlebot.
Googlebot does come to this site regularly but never in this volume, recently only requesting 20-40 files a day. Anyone else out there seeing something weird in their logs today?

ThomasB

7:59 pm on Feb 4, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



3713 hits in which time? A month, a week, a day?

erthlng

7:05 am on Feb 5, 2004 (gmt 0)

10+ Year Member



On the 3rd we had a very heavy crawl of 81412 pages for the day. We see a crawl like that from G, about once a month lately.

webplacing

9:58 am on Feb 5, 2004 (gmt 0)

10+ Year Member



Sorry it wasn't clear, in a day.

ThomasB

11:27 am on Feb 5, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



webplacing, do you use sessions? Parameters in the url? have different versions for different browsers/resolutions? Did you check if GB spidered the same sites over and over again?

Ferran

12:03 pm on Feb 5, 2004 (gmt 0)

10+ Year Member



My record is 13.000 pages of a domain visited by google in a day, but usually I have 7 or 8 domains visited by google bot 2000 o 3000 times in a day.

With PR3 or PR5, not a really high PR, but linked inside optimized

Oaf357

12:10 pm on Feb 5, 2004 (gmt 0)

10+ Year Member



I've noticed an incredibly increase in Googlebot activity on two totally unrelated sites.

I don't have the numbers in front of me at the moment but they are a lot higher than usual.

trillianjedi

3:07 pm on Feb 5, 2004 (gmt 0)

WebmasterWorld Senior Member trillianjedi is a WebmasterWorld Top Contributor of All Time 10+ Year Member



Sounds to me like deepbot is back. I'm seeing this behaviour in the logs too.

Wouldn't that be a step backwards to a google of old?

TJ

webplacing

5:13 pm on Feb 5, 2004 (gmt 0)

10+ Year Member



Hi Thomas,
The site is a static site, no SSI, no dynamic content, no different versions for browsers or languages, no other domain names pointing at it. Nothing but simple HTML pages, weird huh?
 

Featured Threads

Hot Threads This Week

Hot Threads This Month