dstiles - 10:07 pm on Aug 12, 2010 (gmt 0)

Except it won't block all bots. Many do not actually look at robots.txt. They find a domain, they scrape it. :(

Lots of info on this in the SE forum hereabouts but start by blocking every server farm you can find, then add broadband suppliers from the most likely scraping countries such as far east, eastern europe, america (south AND north). :(