Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- Synapse user-agent


dstiles - 7:32 pm on Jan 17, 2013 (gmt 0)


General feeling hereabouts is that "bad" hits are thrown a 403 to send them away again. Sending them to another page without a "go away" code only encourages them. :)


Thread source:: http://www.webmasterworld.com/search_engine_spiders/4532904.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com