Forum Moderators: Robert Charlton & goodroi
My question is this, could it be that the first request was directed to the non www site and since we have a 301 redirect in place for non www to www could that be the second request? Seems logical that is what it would be, but I am not quite clear on how to read these server logs.
66.249.71.62[07/Mar/2006:11:02:57 GET /robots.txt HTTP/1.0 301 - Googlebot/2.1 (+http://www.google.com/bot.html)
66.249.71.62[07/Mar/2006:11:03:02 GET /robots.txt HTTP/1.0 200 - Googlebot/2.1 (+http://www.google.com/bot.html)