Key_Master - 4:16 pm on May 13, 2012 (gmt 0)

Wilderness, the following code should do the trick, but there are more efficient ways of achieving the same effect.


SetEnvIfNoCase User-Agent googlebot google_ua
SetEnvIfNoCase User-Agent (bingbot|msnbot) msn_ua
SetEnvIf Remote_Addr ^66\.249\.(6[4-9]|[78][0-9]|9[0-5])\. google_ip
SetEnvIf Remote_Addr ^65\.5[2-5]\. msn_ip
SetEnvIf Remote_Addr ^70\.37\. msn_ip
SetEnvIf Remote_Addr ^157\.[45][0-9]\. msn_ip
SetEnvIf Remote_Addr ^207\.46\. msn_ip
SetEnvIf Remote_Addr ^207\.[67][0-9]\. msn_ip

RewriteCond %{ENV:google_ua} ^1$
RewriteCond %{ENV:google_ip} !^1$
RewriteRule !^robots\.txt$ - [F]

RewriteCond %{ENV:msn_ua} ^1$
RewriteCond %{ENV:msn_ip} !^1$
RewriteRule !^robots\.txt$ - [F]