Welcome to WebmasterWorld Guest from

Forum Moderators: goodroi

Message Too Old, No Replies

Validation Error

Ran the robots.txt validation checker and recieved nothing but errors.



12:09 pm on Mar 25, 2004 (gmt 0)

10+ Year Member

Any ideas why? I am using FrontPage. I really appreciate any feedback my site is <snip>

[edited by: oilman at 5:32 pm (utc) on Mar. 25, 2004]
[edit reason] no urls please [/edit]


4:47 pm on Mar 25, 2004 (gmt 0)

10+ Year Member

I recently read an article snipped on robots.txt. They have provided a link to robots.txt validator. Well, I checked my robots.txt and faced something similar the first time I did.

I went back to the article:
and saw that I missed some instructions given along with the link-

"Please note that the full path to the robots.txt file must be entered in the field"

I was checking:
whereas I was supposed to check www.example.com/robots.txt

A very simple error which would put your home page to the test rather than the robots.txt file. Well, I guess that this could be a well expected error in usage on the user's part because they have put a small reminder right next to the url field:

"Enter the full url to the robots.txt file on your server" (http://www.searchengineworld.com/cgi-bin/robotcheck.cgi)

I hope that solves your problem.

[edited by: DaveAtIFG at 5:59 pm (utc) on Mar. 25, 2004]
[edit reason] Removed specifics [/edit]


5:06 pm on Mar 25, 2004 (gmt 0)

10+ Year Member

Thanks for the input. Fixed my problem!

Featured Threads

Hot Threads This Week

Hot Threads This Month