Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- the latest impenetrable disguise
keyplyr - 12:02 am on Jan 27, 2013 (gmt 0)Thread source:: http://www.webmasterworld.com/search_engine_spiders/4538507.htm
The request with those headers would get nuked on my sites before it gets to UA or IP check.
Brought to you by WebmasterWorld: http://www.webmasterworld.com