Welcome to WebmasterWorld Guest from 107.20.20.39

Forum Moderators: not2easy

Message Too Old, No Replies

How can I block ALL those whois sites

from having a large copy of our text from our site

   
8:37 am on Sep 24, 2013 (gmt 0)

WebmasterWorld Senior Member zeus is a WebmasterWorld Top Contributor of All Time 10+ Year Member



ALL those whois sites are really getting on my nerves, some even copy your full html from you frontpage. My site has been in trouble for years, slowly I think its be cause of all those whois sites, be cause they have sometimes a full copy of my site text, sometimes 200-500 words.

How can I block those or is there a list of most of those sites ips which could be blocked.
6:14 pm on Sep 30, 2013 (gmt 0)



Hia Zeus. I've recently posted a similar thread [webmasterworld.com...]

As I say there, I strongly object to these companies profiling my website. I've blocked them in my htaccess file, but they've already profiled me, so blocking them is useless IMO.

Hopefully someone will be able to answer our questions . . .

Ali.
6:58 pm on Sep 30, 2013 (gmt 0)

WebmasterWorld Senior Member ken_b is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



That would be useful info for anyone setting up new sites too.

.
7:02 pm on Sep 30, 2013 (gmt 0)



If they outrank you, it means your site is very weak in googles eyes or have some kind of penalty.
7:57 pm on Sep 30, 2013 (gmt 0)

WebmasterWorld Administrator 5+ Year Member Top Contributors Of The Month



You can block them the same way you block all unwanted robots. As Alikiris says, until they decide to remove it, it will stay there. Blocking only the IP of the site won't help much, they likely are scraping each other for the data, and other bots are collecting stuff to sell to them. If you don't plan to spend a few hours a day checking your access logs it becomes a wasted effort.
8:35 pm on Sep 30, 2013 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



My site is only in a few. I put up a blank page late at night, clicked refresh in their settings and poof! duplicate gone.

One could also server them different fodder if their bot's UA or IP is known too <BEG>
 

Featured Threads

Hot Threads This Week

Hot Threads This Month