Page is a not externally linkable
- Google
-- Google AdSense
---- Blekko shows your other sites with the same adsense pub id


acemi - 12:07 pm on Dec 31, 2010 (gmt 0)


If you use ModSecurity 2.x, here is a rule to serve that scoutjet user agent a 403 Forbidden page.

SecRule HTTP_User-Agent "ScoutJet" "deny,log,status:403"


Thanks frontpage

After I added this rule I realised the extent of their bot's crawling with hundreds of 403s in the log. This should keep them away from now on.


Thread source:: http://www.webmasterworld.com/google_adsense/4247326.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com