Welcome to WebmasterWorld Guest from 54.159.214.250

Forum Moderators: goodroi

Googlebot GET /robots.txt HTTP/1.0" 404

Googlebot is the only bot getting 404

   
10:52 pm on Apr 2, 2004 (gmt 0)

10+ Year Member



I have validated the robot file numerous times and can't find anything wrong with it. Googlebot is the only bot getting the 404 error.

I have also noticed that Googlebot will request robots.txt than request a page and then request robots.txt again. It than proceeds to repeat this cycle over and over.

Any clues what is going on?

 

Featured Threads

Hot Threads This Week

Hot Threads This Month