Welcome to WebmasterWorld Guest from 54.242.72.36

Forum Moderators: Ocean10000 & incrediBILL

Message Too Old, No Replies

Blekko how to ban

     

viggen

12:32 pm on Feb 16, 2013 (gmt 0)

10+ Year Member



..can you guys help, Blekko is killing my site, doesnt obey robots txt, and appears with hundreds of bots at the same time doing all sorts of weird things...

IP range is always 199.87.252.xxx and 199.87.253.xxx

wilderness

4:06 pm on Feb 16, 2013 (gmt 0)

WebmasterWorld Senior Member wilderness is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



Their complete range is
199.87.248.0 - 199.87.255.255
CIDR199.87.248.0/21.

1) Do you have an existing and/or functioning htaccess?
(there are none of this forums threads in your user profile).

keyplyr

8:00 pm on Feb 16, 2013 (gmt 0)

WebmasterWorld Senior Member keyplyr is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month





For Blekkobot|ScoutJet I block:


64.13.128.0 - 64.13.191.255
64.13.128.0/18

199.87.248.0 - 199.87.255.255
199.87.248.0/21

dstiles

8:08 pm on Feb 16, 2013 (gmt 0)

WebmasterWorld Senior Member dstiles is a WebmasterWorld Top Contributor of All Time 5+ Year Member



Never found blekko to be a problem. I allow their bots on IP/User-Agent match.

keyplyr

12:41 am on Feb 17, 2013 (gmt 0)

WebmasterWorld Senior Member keyplyr is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month





dstiles, many of us object to Blekko caching our content (even against NOINDEX directives) then displaying these cached copies to the public. They also sell SEO data of all your pages to anyone who subscribes to their SEO service.

Even after I blocked them I had to send Cease & Desist notifications to get them to remove my property from their servers.
 

Featured Threads

Hot Threads This Week

Hot Threads This Month