Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- June 2013 - Blocking Bad Spiders / Bots / User Agents
wilderness - 10:02 am on Jun 24, 2013 (gmt 0)Thread source:: http://www.webmasterworld.com/search_engine_spiders/4586407.htm
FWIW, here's a similar inquiry by yourself in 2007.
Ban certain IP's [webmasterworld.com]
Brought to you by WebmasterWorld: http://www.webmasterworld.com