Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- good riddance to bad robots
dstiles - 7:16 pm on Jun 16, 2013 (gmt 0)Thread source:: http://www.webmasterworld.com/search_engine_spiders/4584531.htm
I had all but two of those ranges blocked; extras now added.
And thanks for starting an IP on its own line: makes it much easier and quicker to paste the IP into my database, even with the extras after it! :)
Brought to you by WebmasterWorld: http://www.webmasterworld.com