homepage Welcome to WebmasterWorld Guest from 54.198.148.191
register, free tools, login, search, subscribe, help, library, announcements, recent posts, open posts,
Pubcon Website
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
Forum Library, Charter, Moderators: goodroi

Sitemaps, Meta Data, and robots.txt Forum

    
robots.txt validator problem?
it is reading my index.htm file?
mbatta




msg:1526039
 11:30 pm on Nov 22, 2004 (gmt 0)

Why is the robots.txt validator reading my /index.htm file? (and of course coming up with a ton of errors)

 

pendanticist




msg:1526040
 11:34 pm on Nov 22, 2004 (gmt 0)

When you insert your root url, are you including /robots.txt?

The service I've used will do as you said, but you need to add that on the end.

mydomain.com-org-info-whatever/robots.txt

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About
© Webmaster World 1996-2014 all rights reserved