Forum Moderators: goodroi

Message Too Old, No Replies

Capitalize robots.txt filename?

Robots.txt or robots.txt

         

4string

1:40 pm on Nov 16, 2005 (gmt 0)

10+ Year Member



MSNbot keeps hitting on my robots file and leaving. It's not disallowed.

I see in their help file they specify to name the file Robots.txt. If it is robots.txt, you may have trouble, they say. I find that strange.

If I capitalize it, will I cause any troubles for the other spiders?

encyclo

3:18 am on Nov 17, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



"robots.txt" and "Robots.txt" are not the same file, except on Windows servers which use case-insensitive filenames. The official standard is for "robots.txt" with no capital letter. If you use a capital letter on a non-Windows server the bots would get a 404 not found error.

If MSNbot is visiting your file and is not served an error, then it is finding it correctly. You should not rename it.

4string

4:18 am on Nov 17, 2005 (gmt 0)

10+ Year Member



It sure is strange that MSN would specify it with a capital 'R' in their webmaster help file. But on closer inspection they seem to be differentiating between the plural and singular - robot and Robots. I never heard of MS getting anything wrong before.

Thanks for the clarification!