Forum Moderators: DixonJones

Message Too Old, No Replies

New Robots.txt

         

Treddy85au

1:13 pm on Apr 9, 2006 (gmt 0)

10+ Year Member



Hi,

I just created a robots.txt and upload it to my webserver root directory and google is saying this;
robots.txt file does not appear to be valid.

Can you please help me.

Tastatura

5:05 pm on Apr 9, 2006 (gmt 0)

10+ Year Member



Welcome to WebmasterWorld Treddy85au.

you can use this to check if your robots.txt file validates:
[searchenginepromotionhelp.com ]

Also, good resources on the topic can be found here:
[robotstxt.org ]

Treddy85au

10:37 pm on Apr 9, 2006 (gmt 0)

10+ Year Member




Thanks for getting back to me about this. I used that link and now I'm really confused it's saying Disallow: /
The line below this disallow must be another disallow statement or a blank line. This doesn't make sense to me.

Cheers