Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- June 2013 - Blocking Bad Spiders / Bots / User Agents
Key_Master - 7:53 pm on Jun 22, 2013 (gmt 0)Thread source:: http://www.webmasterworld.com/search_engine_spiders/4586407.htm
That list is old- very old. I don't even think the link should be allowed because it's only going to confuse people more.
Anyhow, most of the really bad bots don't use obvious user-agents.
Brought to you by WebmasterWorld: http://www.webmasterworld.com