Welcome to WebmasterWorld Guest from

Forum Moderators: goodroi

Message Too Old, No Replies

Bad style in robots.txt file. Why?



7:22 am on Jun 1, 2001 (gmt 0)

When I use Robots.txt validator I receive this error:
It validates, but has some bad style.

2 warning Robots.txt contains DOS or Mac line enders. Although it is so common most spiders will deal correctly with the file, it is not a valid format.

robots.txt source code for [XXXXXXXXXX.com...]
Line Code
1 User-agent: *
2 Disallow:
I don't understand because I receive this message.Please help me to resolve this problem.
Thanks in advance for your help.


8:51 am on Jun 1, 2001 (gmt 0)

10+ Year Member

perhaps it's depend of the text editor you use to make the robot text which can put some characters in your file, or in what format you save the file (DOS, UNIX, MAC,...)


8:56 am on Jun 1, 2001 (gmt 0)

I use Notepad and Windows98. I upload this file with Cute.FTP in ASCII mode.
Which program i have to use to resolve this problem?
Thanks in advance.


9:38 am on Jun 1, 2001 (gmt 0)

10+ Year Member

i use pfe.

the problems is perhaps in the end of the line (differences between DOS and UNIX).

any other idea ??


10:25 am on Jun 1, 2001 (gmt 0)

My friend has written for me the robots.txt in Unix mode and now is correct.
Thanks a lot for your help.

Featured Threads

Hot Threads This Week

Hot Threads This Month