Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- denied landing page


keyplyr - 9:41 pm on Feb 5, 2012 (gmt 0)




keyplyr, what happens on subsequent visits? Do they always have to reload?


If they are still coming from the same blocked IP, yes they will need to do it every time because it is by session id. Note that none of the IP ranges I block are commonly used by innocent human surfers. I just added this for that rare possibility that someone at work is surfing on their own.

Also, the humans that have installed harvesting tools do not get a second chance as long as that attribute is present in their UA string.


Thread source:: http://www.webmasterworld.com/search_engine_spiders/4414340.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com