Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- -very- much the same robot
blend27 - 10:10 pm on Feb 4, 2013 (gmt 0)Thread source:: http://www.webmasterworld.com/search_engine_spiders/4498453.htm
Did that on the spot, he was very impressed, everything is peachy.
BTW, here is a thread from 2011 with some ranges/htaccess by caribguy:
Brought to you by WebmasterWorld: http://www.webmasterworld.com