Welcome to WebmasterWorld Guest from 54.167.229.178

Forum Moderators: Ocean10000 & incrediBILL & keyplyr

Message Too Old, No Replies

Blekko how to ban

     
12:32 pm on Feb 16, 2013 (gmt 0)

Preferred Member

10+ Year Member

joined:Apr 24, 2003
posts:544
votes: 0


..can you guys help, Blekko is killing my site, doesnt obey robots txt, and appears with hundreds of bots at the same time doing all sorts of weird things...

IP range is always 199.87.252.xxx and 199.87.253.xxx
4:06 pm on Feb 16, 2013 (gmt 0)

Senior Member

WebmasterWorld Senior Member wilderness is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Nov 11, 2001
posts:5437
votes: 2


Their complete range is
199.87.248.0 - 199.87.255.255
CIDR199.87.248.0/21.

1) Do you have an existing and/or functioning htaccess?
(there are none of this forums threads in your user profile).
8:00 pm on Feb 16, 2013 (gmt 0)

Moderator This Forum from US 

WebmasterWorld Administrator keyplyr is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Sept 26, 2001
posts:6148
votes: 75




For Blekkobot|ScoutJet I block:


64.13.128.0 - 64.13.191.255
64.13.128.0/18

199.87.248.0 - 199.87.255.255
199.87.248.0/21
8:08 pm on Feb 16, 2013 (gmt 0)

Senior Member from GB 

WebmasterWorld Senior Member dstiles is a WebmasterWorld Top Contributor of All Time 5+ Year Member Top Contributors Of The Month

joined:May 14, 2008
posts:3101
votes: 3


Never found blekko to be a problem. I allow their bots on IP/User-Agent match.
12:41 am on Feb 17, 2013 (gmt 0)

Moderator This Forum from US 

WebmasterWorld Administrator keyplyr is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Sept 26, 2001
posts:6148
votes: 75




dstiles, many of us object to Blekko caching our content (even against NOINDEX directives) then displaying these cached copies to the public. They also sell SEO data of all your pages to anyone who subscribes to their SEO service.

Even after I blocked them I had to send Cease & Desist notifications to get them to remove my property from their servers.
 

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members