Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- Munax bots cloaking themselves and causing high server load


Achernar - 12:07 am on Apr 8, 2008 (gmt 0)


They don't obey robots.txt, else they wouldn't get caught in bot-traps.

[edited by: Achernar at 12:11 am (utc) on April 8, 2008]


Thread source:: http://www.webmasterworld.com/search_engine_spiders/3616493.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com