tangor - 11:28 pm on Sep 28, 2013 (gmt 0)
Robots.txt is a mixed blessing. The good bots will follow. The bad bots will say, "Cool, here we strike next!"
Above is tongue-in-cheek to a certain extent... I do disallow many bots at the root level and (surprise!) most of them comply. Those that don't end up in .htaccess.
That said, on the two wp sites I manage, you won't find any mention of wp in the robots.txt... and any calls for those system files that do not originate from the site itself are not honored (403)