Perhaps Iím being picky again, but I think I disagree with this. RFC 959 in section 188.8.131.52 states
So, under ASCII mode, the end of lines are converted by the client from CR (Mac) or LF (Unix) to CRLF. Windows/DOS clients need make no conversion as it already uses the telnet standard end of lines. The file is transferred across the network and the FTP server makes the translation from CRLF to (Mac) or LF (Unix) when it stores it. Again, Windows/DOS servers make no translation.
If you want to guarantee LF for end of line in the uploaded robots.txt you should edit the file locally in Unix mode and upload in binary mode. This will stop both the client and the server making any transformations.
DOS end of lines is 100% valid for robots.txt, but, if you feel that some search engines donít follow the spec and are confused by then there is no harm in adding a few extra rules of your own to the robots.txt spec.
I would be surprised, however, if search engines cannot handle DOS end of lines, since a lot of internet protocols use CRLF as the end of line (TELNET, FTP, HTTP).