| Welcome to WebmasterWorld Guest from 188.8.131.52 |
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
|Become a Pro Member|
|robots.txt validator problem?|
it is reading my index.htm file?
| 11:30 pm on Nov 22, 2004 (gmt 0)|
Why is the robots.txt validator reading my /index.htm file? (and of course coming up with a ton of errors)
| 11:34 pm on Nov 22, 2004 (gmt 0)|
When you insert your root url, are you including /robots.txt?
The service I've used will do as you said, but you need to add that on the end.
All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved