We currently block the libwww-perl user agent in our .htaccess. Its main use appears to be for script kiddies to sniff around for injection vulnerabilities.
Unfortunately, however, W3C uses it for their online link checker.
Is it possible to construct a RewriteCond that will block all libwww-perl user agents UNLESS it contains "W3C-checklink"?
Thanks!