Welcome to WebmasterWorld Guest from 54.196.153.46

Forum Moderators: open

Message Too Old, No Replies

Googlebot going nuts!

googlebot trawling lots of pages

     
4:49 pm on Feb 4, 2004 (gmt 0)

New User

10+ Year Member

joined:Dec 31, 2003
posts:9
votes: 0


I've just been going through some logs for a client who has a 50 page web site and noticed something a little strange.
3713 accesses by Googlebot.
Googlebot does come to this site regularly but never in this volume, recently only requesting 20-40 files a day. Anyone else out there seeing something weird in their logs today?
7:59 pm on Feb 4, 2004 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Dec 5, 2002
posts:1562
votes: 0


3713 hits in which time? A month, a week, a day?
7:05 am on Feb 5, 2004 (gmt 0)

New User

10+ Year Member

joined:June 18, 2003
posts:28
votes: 0


On the 3rd we had a very heavy crawl of 81412 pages for the day. We see a crawl like that from G, about once a month lately.
9:58 am on Feb 5, 2004 (gmt 0)

New User

10+ Year Member

joined:Dec 31, 2003
posts:9
votes: 0


Sorry it wasn't clear, in a day.
11:27 am on Feb 5, 2004 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Dec 5, 2002
posts:1562
votes: 0


webplacing, do you use sessions? Parameters in the url? have different versions for different browsers/resolutions? Did you check if GB spidered the same sites over and over again?
12:03 pm on Feb 5, 2004 (gmt 0)

New User

10+ Year Member

joined:Feb 3, 2004
posts:7
votes: 0


My record is 13.000 pages of a domain visited by google in a day, but usually I have 7 or 8 domains visited by google bot 2000 o 3000 times in a day.

With PR3 or PR5, not a really high PR, but linked inside optimized

12:10 pm on Feb 5, 2004 (gmt 0)

Preferred Member

10+ Year Member

joined:Mar 5, 2003
posts:636
votes: 0


I've noticed an incredibly increase in Googlebot activity on two totally unrelated sites.

I don't have the numbers in front of me at the moment but they are a lot higher than usual.

3:07 pm on Feb 5, 2004 (gmt 0)

Senior Member

WebmasterWorld Senior Member trillianjedi is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:Apr 15, 2003
posts:7246
votes: 0


Sounds to me like deepbot is back. I'm seeing this behaviour in the logs too.

Wouldn't that be a step backwards to a google of old?

TJ

5:13 pm on Feb 5, 2004 (gmt 0)

New User

10+ Year Member

joined:Dec 31, 2003
posts:9
votes: 0


Hi Thomas,
The site is a static site, no SSI, no dynamic content, no different versions for browsers or languages, no other domain names pointing at it. Nothing but simple HTML pages, weird huh?
 

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members