joined:Oct 8, 2001
I've seen this hit a couple webmasters lately and wanted to mention it. If someone requests a robots.txt file, don't return some custom 404 page or strange page with HTML, graphics, etc. This can happen if your webserver is configured to return a pretty page for requests when the page doesn't exist.
Just a straight text robots file or no robots.txt at all is preferred. Just lookin' out for things the sometimes catch people..