Welcome to WebmasterWorld Guest from 54.146.201.80

Forum Moderators: goodroi

Message Too Old, No Replies

robots.txt

warning; robots.txt containing DOS or Mac line

     
11:03 am on Apr 24, 2001 (gmt 0)

New User

joined:Aug 13, 2013
posts:5
votes: 0


I've created a robots.txt file using Notepad with the .txt extension and the following entries:

User-agent: *
Disallow: /

When trying to validate the robots.txt at the searchengineworld website, I received the following warning:

warning Robots.txt contains DOS or Mac line enders. Although it is so common most spiders will deal correctly with the file, it is not a valid format.

I would appreciate if someone can help me. Thank you very much and have a great day!

roma

1:06 pm on Apr 24, 2001 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Sept 21, 1999
posts:2141
votes: 0


DOS or Mac based systems expect each line in a text file to end with a carrige return and a line feed character. *nix based systems expect only a line feed. When you FTP a file using binary mode the file is transferred exactly as created. Text files should be uploaded to *nix systems using ASCII mode which strips out the unneeded carrige returns.

The error you saw is probably due to a transfer using binary mode.

10:25 pm on Apr 24, 2001 (gmt 0)

New User

joined:Aug 13, 2013
posts:5
votes: 0


I would like to take this opportunity to greatfully thank you for your assistance regarding the robots.txt matter. I did exactly what you recommended and it worked fine. Once again, thank you very much!

Sincerely yours,

roma

8:10 am on Apr 25, 2001 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Sept 21, 1999
posts:2141
votes: 0


You're very welcome roma! I forgot to say welcome to WmW too, sorry. We're pleased to have you join us. Read and learn and contribute where you can to help others learn too!
10:35 am on Apr 25, 2001 (gmt 0)

New User

joined:Aug 13, 2013
posts:5
votes: 0


Thank you very much for welcoming me to Webmaster World.com. It would be my pleasure to offer my share of assistance on things I know. Have a wonderfull day and once again, thank you very much for the assistance!

Sincerely yours,

roma

 

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members