Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- Secure Sites From Botnet Vulnerability Probes


keyplyr - 7:02 pm on May 10, 2007 (gmt 0)


Thanks Bill. I have always blocked "libwww-perl" using a white-list to allow only a few trusted IP addresses permission to use that generic UA.

I'm added the block for QUERY_STRING containing "=http:" and will see how it goes over the next week or so.

Actually, I've never seen this query yet, but I probably miss more than I think.


Thread source:: http://www.webmasterworld.com/search_engine_spiders/3335216.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com