incrediBILL - 10:22 pm on Aug 2, 2012 (gmt 0)

Note that they claim Twitterbot honors robots.txt!

URL crawling Twitter's crawler will respect robots.txt when scanning URLs. If a page with card markup is blocked, no card will be shown. If an image URL is blocked, no thumbnail or photo will be shown. Twitter uses the User-Agent of Twitterbot/1.0, which can be used to create an exception in your robots.txt file. For example, here is a robots.txt which disallows crawling for all robots except Twitter's fetcher: User-agent: Twitterbot Disallow: User-agent: * Disallow: /