Forum Moderators: Robert Charlton & goodroi

Message Too Old, No Replies

Robots.txt trouble verifying with Google Sitemap

         

rico9

5:33 pm on Jan 21, 2006 (gmt 0)



My robots text validates and I can see nothing wrong with it. But Google says it is keeping my site from being verified. What can I do?

tedster

3:27 am on Jan 23, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Welcome to the forums, rico9

Google's message is most certainly automated -- but it does mean that your server returned something problematic. I know you said you validated the file, but how? Have you used the validator or SearchEngineWorld (our sister site)?

[searchengineworld.com...]

Also, note there's a wealth of other information about robots.txt available from that page. Also, though it is an unlikely problem I'd say, check that your server is returning a proper mime type for the .txt file

Content-Type: text/plain