Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- possible botnet


dstiles - 7:30 pm on Jul 12, 2012 (gmt 0)


Depends on why blocked and how legit. I sometimes get clients say "You've blocked email from X" and it turns out the idiots are running a mail server on a broadband line - often static but it's still a supid idea when the whole range is in at least one good RBL. I'm the one who then has to "poke a hole" in the banned block.


Thread source:: http://www.webmasterworld.com/search_engine_spiders/4474787.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com