Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- Filtering Out Really Hard To Find Bad Bots


wilderness - 4:05 am on Jan 20, 2013 (gmt 0)


Admittedly this is easier if you've got a browser with some distinguishing features.


It's not difficult to modify UA's, I have widget users due it occasionally. The user adds a keyword, notifies me of the word and I add an exception.
The most recent was a rural area that was assigned an Embarq IP from their local provider. (I'm not a happy camper with Embarq).


Thread source:: http://www.webmasterworld.com/search_engine_spiders/4536448.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com