Welcome to WebmasterWorld Guest from 54.147.10.12

Forum Moderators: open

Message Too Old, No Replies

Googlebot going nuts!

googlebot trawling lots of pages

     
4:49 pm on Feb 4, 2004 (gmt 0)

New User

10+ Year Member

joined:Dec 31, 2003
posts:9
votes: 0


I've just been going through some logs for a client who has a 50 page web site and noticed something a little strange.
3713 accesses by Googlebot.
Googlebot does come to this site regularly but never in this volume, recently only requesting 20-40 files a day. Anyone else out there seeing something weird in their logs today?
7:59 pm on Feb 4, 2004 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Dec 5, 2002
posts:1562
votes: 0


3713 hits in which time? A month, a week, a day?
7:05 am on Feb 5, 2004 (gmt 0)

New User

10+ Year Member

joined:June 18, 2003
posts:28
votes: 0


On the 3rd we had a very heavy crawl of 81412 pages for the day. We see a crawl like that from G, about once a month lately.
9:58 am on Feb 5, 2004 (gmt 0)

New User

10+ Year Member

joined:Dec 31, 2003
posts:9
votes: 0


Sorry it wasn't clear, in a day.
11:27 am on Feb 5, 2004 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Dec 5, 2002
posts:1562
votes: 0


webplacing, do you use sessions? Parameters in the url? have different versions for different browsers/resolutions? Did you check if GB spidered the same sites over and over again?
12:03 pm on Feb 5, 2004 (gmt 0)

New User

10+ Year Member

joined:Feb 3, 2004
posts:7
votes: 0


My record is 13.000 pages of a domain visited by google in a day, but usually I have 7 or 8 domains visited by google bot 2000 o 3000 times in a day.

With PR3 or PR5, not a really high PR, but linked inside optimized

12:10 pm on Feb 5, 2004 (gmt 0)

Preferred Member

10+ Year Member

joined:Mar 5, 2003
posts:636
votes: 0


I've noticed an incredibly increase in Googlebot activity on two totally unrelated sites.

I don't have the numbers in front of me at the moment but they are a lot higher than usual.

3:07 pm on Feb 5, 2004 (gmt 0)

Senior Member

WebmasterWorld Senior Member trillianjedi is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:Apr 15, 2003
posts:7242
votes: 0


Sounds to me like deepbot is back. I'm seeing this behaviour in the logs too.

Wouldn't that be a step backwards to a google of old?

TJ

5:13 pm on Feb 5, 2004 (gmt 0)

New User

10+ Year Member

joined:Dec 31, 2003
posts:9
votes: 0


Hi Thomas,
The site is a static site, no SSI, no dynamic content, no different versions for browsers or languages, no other domain names pointing at it. Nothing but simple HTML pages, weird huh?