pageoneresults - 11:16 pm on Dec 6, 2010 (gmt 0)
<meta name="robots" content="noarchive"> The above is mandatory for all sites that we do. > Why?
Because I think it is one more area that if left unchecked can create fragmentation of your content not to mention a host of other issues that "I" think occur on a regular basis. There's no need for anyone to have access to a potentially older version of a web document. And the argument that "if the site is down" doesn't hold much water these days. If your site is down that much where you need to rely on cache, then your woes goes much deeper.
Take away cache and Archive.org and you've eliminated two major points of untethered access. Take control in those areas and add a robust bot blocking routine and you've taken a major step forward. It's a matter of protecting your assets.