Welcome to WebmasterWorld Guest from 54.161.95.0

Forum Moderators: not2easy

Message Too Old, No Replies

How can I block ALL those whois sites

from having a large copy of our text from our site

     
8:37 am on Sep 24, 2013 (gmt 0)

Senior Member

WebmasterWorld Senior Member zeus is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:Apr 28, 2002
posts:3443
votes: 1


ALL those whois sites are really getting on my nerves, some even copy your full html from you frontpage. My site has been in trouble for years, slowly I think its be cause of all those whois sites, be cause they have sometimes a full copy of my site text, sometimes 200-500 words.

How can I block those or is there a list of most of those sites ips which could be blocked.
6:14 pm on Sept 30, 2013 (gmt 0)

New User

joined:Sept 26, 2013
posts: 11
votes: 0


Hia Zeus. I've recently posted a similar thread [webmasterworld.com...]

As I say there, I strongly object to these companies profiling my website. I've blocked them in my htaccess file, but they've already profiled me, so blocking them is useless IMO.

Hopefully someone will be able to answer our questions . . .

Ali.
6:58 pm on Sept 30, 2013 (gmt 0)

Senior Member from US 

WebmasterWorld Senior Member ken_b is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Oct 5, 2001
posts:5728
votes: 72


That would be useful info for anyone setting up new sites too.

.
7:02 pm on Sept 30, 2013 (gmt 0)

New User

joined:Apr 25, 2012
posts:30
votes: 0


If they outrank you, it means your site is very weak in googles eyes or have some kind of penalty.
7:57 pm on Sept 30, 2013 (gmt 0)

Moderator This Forum from US 

WebmasterWorld Administrator 5+ Year Member Top Contributors Of The Month

joined:Dec 27, 2006
posts:2688
votes: 56


You can block them the same way you block all unwanted robots. As Alikiris says, until they decide to remove it, it will stay there. Blocking only the IP of the site won't help much, they likely are scraping each other for the data, and other bots are collecting stuff to sell to them. If you don't plan to spend a few hours a day checking your access logs it becomes a wasted effort.
8:35 pm on Sept 30, 2013 (gmt 0)

Senior Member from US 

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month

joined:Sept 21, 2002
posts:735
votes: 8


My site is only in a few. I put up a blank page late at night, clicked refresh in their settings and poof! duplicate gone.

One could also server them different fodder if their bot's UA or IP is known too <BEG>