Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- Blekko how to ban
viggen - 12:32 pm on Feb 16, 2013 (gmt 0)Thread source:: http://www.webmasterworld.com/search_engine_spiders/4546109.htm
..can you guys help, Blekko is killing my site, doesnt obey robots txt, and appears with hundreds of bots at the same time doing all sorts of weird things...
IP range is always 199.87.252.xxx and 199.87.253.xxx
Brought to you by WebmasterWorld: http://www.webmasterworld.com