homepage Welcome to WebmasterWorld Guest from 54.196.194.204
register, free tools, login, search, subscribe, help, library, announcements, recent posts, open posts,
Subscribe to WebmasterWorld
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
Forum Library, Charter, Moderators: goodroi

Sitemaps, Meta Data, and robots.txt Forum

    
Bad style in robots.txt file. Why?
billyblu




msg:1525950
 7:22 am on Jun 1, 2001 (gmt 0)

When I use Robots.txt validator I receive this error:
It validates, but has some bad style.

2 warning Robots.txt contains DOS or Mac line enders. Although it is so common most spiders will deal correctly with the file, it is not a valid format.
Disallow:

robots.txt source code for [XXXXXXXXXX.com...]
Line Code
1 User-agent: *
2 Disallow:
I don't understand because I receive this message.Please help me to resolve this problem.
Thanks in advance for your help.
Regards.

 

Steph




msg:1525951
 8:51 am on Jun 1, 2001 (gmt 0)

perhaps it's depend of the text editor you use to make the robot text which can put some characters in your file, or in what format you save the file (DOS, UNIX, MAC,...)

billyblu




msg:1525952
 8:56 am on Jun 1, 2001 (gmt 0)

I use Notepad and Windows98. I upload this file with Cute.FTP in ASCII mode.
Which program i have to use to resolve this problem?
Thanks in advance.

Steph




msg:1525953
 9:38 am on Jun 1, 2001 (gmt 0)

i use pfe.

the problems is perhaps in the end of the line (differences between DOS and UNIX).

any other idea ??

billyblu




msg:1525954
 10:25 am on Jun 1, 2001 (gmt 0)

My friend has written for me the robots.txt in Unix mode and now is correct.
Thanks a lot for your help.
Regards.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved