Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- AVG Toolbar Glitch May Be Causing Visitor Loss


Ocean10000 - 2:59 pm on May 3, 2008 (gmt 0)


Even if they fix the User-Agent. I would still be blocking this activity. Since it does not match other known characteristics of Microsoft Internet Explorer, aka its missing other headers which IE provides.

I have two or three of these a day pound away receiving 403 errors the whole time, usually give up around 30 attempts or so each.


Thread source:: http://www.webmasterworld.com/search_engine_spiders/3615360.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com