phranque - 1:42 am on Aug 28, 2010 (gmt 0)
it depends partly on how far you want to go and how much information about your configuration and your definition of a "good bot" you want to expose.
this thread should cover many of the issues and methods.
In the era of increasing numbers of bad bots is robots.txt irrelevant?: