Welcome to WebmasterWorld Guest from 18.104.22.168
Forum Moderators: goodroi
However, if you monitor your site logs, you can save yourself from having to wade through a lot of
404-Not Found errors by uploading at least a blank robots.txt file, as recommended by GoogleGuy.
This prevents your server from sending a 404 response code back to robots which request robots.txt,
and from logging that error response. But since the file is empty, it doesn't exclude any robots.
More info here [robotstxt.org].
<added>jdMorgan pretty much said already this while I was typing this!</added>