Forum Moderators: goodroi
User-agent: *Disallow: /somefolder/somefile.aspx
We're sorry, this robots.txt does NOT validate.
Warnings Detected: 1
Errors Detected: 1
1 warning An empty user agent field was detected. Each User-Agent record should have atleast one disallow line per record. This error may have also been generated due to bad line enders.
------------------------------------
User-agent: *Disallow: /somefolder/somefile.aspx
------------------------------------
What I really want to know is if robots are seeing this robot.txt line will it react to such a error code...
Have anyone experienced to this situation? Pls give me an explaination...
Thanks...
I've check this by searchengineworld dot com and it return error message. So what I'm wondering is robot.txt feature in google sitemap have shown no error.
What I really want to know is it will be affect to robot when they see the error and leave my site immediately...
Thanks,