Welcome to WebmasterWorld Guest from

Forum Moderators: goodroi

Message Too Old, No Replies

Googlebot GET /robots.txt HTTP/1.0" 404

Googlebot is the only bot getting 404



10:52 pm on Apr 2, 2004 (gmt 0)

10+ Year Member

I have validated the robot file numerous times and can't find anything wrong with it. Googlebot is the only bot getting the 404 error.

I have also noticed that Googlebot will request robots.txt than request a page and then request robots.txt again. It than proceeds to repeat this cycle over and over.

Any clues what is going on?


Featured Threads

Hot Threads This Week

Hot Threads This Month