Dijkgraaf - 12:38 am on Apr 5, 2012 (gmt 0)
Reading your robots.txt
You allow ia_archiver and MSNPTC full access to your site.
All others you tell them not to ask for the following
As lucy24 says, bad bots don't read/obey it anyway.
There have been various discussions regarding bot traps in the forum Search Engine Spider and User Agent Identification, in particular start reading the thread Quick primer on identifying bot activity: And a how to guide to slow and stop scraping [webmasterworld.com...]