Forum Moderators: goodroi

Message Too Old, No Replies

Understanding Robot Txt Validator Results

I don't know what my results mean.

         

Caran

3:25 pm on Jun 17, 2006 (gmt 0)

10+ Year Member



I have checked my robot.txt with the validator here but don't have a clue what the results mean. I have tried to do some reading around the subject but can't find the answer I'm looking for.

My results show a whole series of errors which I'm assuming is a bad thing. I need a little help in understanding before I go to the people who built our site.

eg. ERROR Invalid line:
<!doc type html public "//W3C//DTD HTML 4.01 Transitional//EN"> Lots like this.

The site is built from an osCommerce template.

Any help with clarifiaction is greatly appreciated, Caran.

DanA

4:01 pm on Jun 17, 2006 (gmt 0)

10+ Year Member



You are not checking a robots.txt file at the root of your site but a html file.
Did you enter www.example.com/robots.txt?

Caran

4:27 pm on Jun 17, 2006 (gmt 0)

10+ Year Member



When I do this the system says it does require me to do this and returns 404 NOT FOUND.

Thanks Caran.

Caran

4:28 pm on Jun 17, 2006 (gmt 0)

10+ Year Member



Sorry should say does NOT require me to do this, C.