supercyberbob - 8:23 pm on May 30, 2010 (gmt 0)
Google has had an unofficial directive for robots.txt for a while now, an equivalent of a noindex tag.
I believe it only works for the Googlebot user agent. Been using it and it works.
You need to be careful integrating it with directives for other bots though.