| Welcome to WebmasterWorld Guest from 220.127.116.11 |
register, free tools, login, search, subscribe, help, library, announcements, recent posts, open posts,
|Subscribe and Support WebmasterWorld|
|Googlebot GET /robots.txt HTTP/1.0" 404 |
Googlebot is the only bot getting 404
| 10:52 pm on Apr 2, 2004 (gmt 0)|
I have validated the robot file numerous times and can't find anything wrong with it. Googlebot is the only bot getting the 404 error.
I have also noticed that Googlebot will request robots.txt than request a page and then request robots.txt again. It than proceeds to repeat this cycle over and over.
Any clues what is going on?
All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
© Webmaster World 1996-2013 all rights reserved