MSNbot keeps hitting on my robots file and leaving. It's not disallowed.
I see in their help file they specify to name the file Robots.txt. If it is robots.txt, you may have trouble, they say. I find that strange.
If I capitalize it, will I cause any troubles for the other spiders?
encyclo
3:18 am on Nov 17, 2005 (gmt 0)
"robots.txt" and "Robots.txt" are not the same file, except on Windows servers which use case-insensitive filenames. The official standard is for "robots.txt" with no capital letter. If you use a capital letter on a non-Windows server the bots would get a 404 not found error.
If MSNbot is visiting your file and is not served an error, then it is finding it correctly. You should not rename it.
4string
4:18 am on Nov 17, 2005 (gmt 0)
It sure is strange that MSN would specify it with a capital 'R' in their webmaster help file. But on closer inspection they seem to be differentiating between the plural and singular - robot and Robots. I never heard of MS getting anything wrong before.