Forum Moderators: open

Message Too Old, No Replies

Googlebot addicted to my index file

8 accesses in 2 hours

         

jrobbio

10:03 am on Jun 6, 2003 (gmt 0)

10+ Year Member



Although my site has appeared to be crawled normally, freshbot seems to have some sort of memory fault with my index file. Anyone else noticed this?

64.68.82.18 - - [06/Jun/2003:08:04:07 +0100] "GET / HTTP/1.0" 200 5469 "-" "Googlebot/2.1 (+http://www.googlebot.com/bot.html)"

64.68.82.58 - - [06/Jun/2003:08:34:20 +0100] "GET / HTTP/1.0" 200 5469 "-" "Googlebot/2.1 (+http://www.googlebot.com/bot.html)"

64.68.82.28 - - [06/Jun/2003:08:46:45 +0100] "GET / HTTP/1.0" 200 5469 "-" "Googlebot/2.1 (+http://www.googlebot.com/bot.html)"

64.68.82.14 - - [06/Jun/2003:08:49:50 +0100] "GET / HTTP/1.0" 200 5469 "-" "Googlebot/2.1 (+http://www.googlebot.com/bot.html)"

64.68.82.28 - - [06/Jun/2003:08:56:34 +0100] "GET / HTTP/1.0" 200 26302 "-" "Googlebot/2.1 (+http://www.googlebot.com/bot.html)"

64.68.82.58 - - [06/Jun/2003:09:00:36 +0100] "GET / HTTP/1.0" 200 5469 "-" "Googlebot/2.1 (+http://www.googlebot.com/bot.html)"

64.68.82.28 - - [06/Jun/2003:09:15:52 +0100] "GET / HTTP/1.0" 200 5469 "-" "Googlebot/2.1 (+http://www.googlebot.com/bot.html)"

64.68.82.39 - - [06/Jun/2003:09:58:33 +0100] "GET / HTTP/1.0" 200 5469 "-" "Googlebot/2.1 (+http://www.googlebot.com/bot.html)"

jrobbio

11:46 am on Jun 6, 2003 (gmt 0)

10+ Year Member



This page is actually normally compressed with Gzip yet one time the googlebot doesn't take the header and downloads it uncompressed at 26302. Is there any reason for this?