Welcome to WebmasterWorld Guest from 54.144.3.134

Forum Moderators: goodroi

Message Too Old, No Replies

robots.txt validator problem?

it is reading my index.htm file?

     
11:30 pm on Nov 22, 2004 (gmt 0)

Junior Member

10+ Year Member

joined:Sept 10, 2004
posts:52
votes: 0


Why is the robots.txt validator reading my /index.htm file? (and of course coming up with a ton of errors)
11:34 pm on Nov 22, 2004 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Apr 27, 2002
posts:1685
votes: 0


When you insert your root url, are you including /robots.txt?

The service I've used will do as you said, but you need to add that on the end.

mydomain.com-org-info-whatever/robots.txt