frontpage - 3:04 pm on Jan 2, 2011 (gmt 0)
I did everything they documented to stop archive.org from crawling or showing my sites on archive.org and it didn't work.
I requested that archive.org delist our sites and they complied.
Blocked Site Error.
domain .com is not available in the Wayback Machine.
However, they still try to spider our sites after the fact.
So, again... I use the magic of Mod-Security to ban them and monitor their IP range.
SecRule HTTP_User-Agent "ia_archiver" "deny,log,status:403"
An example from today:
Access denied with code 403 (phase 2). Pattern match "ia_archiver" at REQUEST_HEADERS:User-Agent. [file "/usr/local/apache/conf/modsec2.user.conf"] [line "393"]