Forum Moderators: goodroi
I went back to the article:
snipped
and saw that I missed some instructions given along with the link-
"Please note that the full path to the robots.txt file must be entered in the field"
I was checking:
www.example.com
whereas I was supposed to check www.example.com/robots.txt
A very simple error which would put your home page to the test rather than the robots.txt file. Well, I guess that this could be a well expected error in usage on the user's part because they have put a small reminder right next to the url field:
"Enter the full url to the robots.txt file on your server" (http://www.searchengineworld.com/cgi-bin/robotcheck.cgi)
I hope that solves your problem.
[edited by: DaveAtIFG at 5:59 pm (utc) on Mar. 25, 2004]
[edit reason] Removed specifics [/edit]