homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Google / Google News Archive
Forum Library, Charter, Moderator: open

Google News Archive Forum

Googlebot going nuts!
googlebot trawling lots of pages

 4:49 pm on Feb 4, 2004 (gmt 0)

I've just been going through some logs for a client who has a 50 page web site and noticed something a little strange.
3713 accesses by Googlebot.
Googlebot does come to this site regularly but never in this volume, recently only requesting 20-40 files a day. Anyone else out there seeing something weird in their logs today?



 7:59 pm on Feb 4, 2004 (gmt 0)

3713 hits in which time? A month, a week, a day?


 7:05 am on Feb 5, 2004 (gmt 0)

On the 3rd we had a very heavy crawl of 81412 pages for the day. We see a crawl like that from G, about once a month lately.


 9:58 am on Feb 5, 2004 (gmt 0)

Sorry it wasn't clear, in a day.


 11:27 am on Feb 5, 2004 (gmt 0)

webplacing, do you use sessions? Parameters in the url? have different versions for different browsers/resolutions? Did you check if GB spidered the same sites over and over again?


 12:03 pm on Feb 5, 2004 (gmt 0)

My record is 13.000 pages of a domain visited by google in a day, but usually I have 7 or 8 domains visited by google bot 2000 o 3000 times in a day.

With PR3 or PR5, not a really high PR, but linked inside optimized


 12:10 pm on Feb 5, 2004 (gmt 0)

I've noticed an incredibly increase in Googlebot activity on two totally unrelated sites.

I don't have the numbers in front of me at the moment but they are a lot higher than usual.


 3:07 pm on Feb 5, 2004 (gmt 0)

Sounds to me like deepbot is back. I'm seeing this behaviour in the logs too.

Wouldn't that be a step backwards to a google of old?



 5:13 pm on Feb 5, 2004 (gmt 0)

Hi Thomas,
The site is a static site, no SSI, no dynamic content, no different versions for browsers or languages, no other domain names pointing at it. Nothing but simple HTML pages, weird huh?

Global Options:
 top home search open messages active posts  

Home / Forums Index / Google / Google News Archive
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved