jojy - 12:38 pm on Apr 3, 2013 (gmt 0)
Gaia, all these spoofed Biongbots are coming from hosting companies that should be blocked by default
99.9% scrapers are coming from shared hosting sites such as hostgator, bluehost, etc They use fake user agents such as Yahoo, Bing, Google, Baidu, etc. Scrapers are top on my contents and my site is no where on SERP!
My dedicated firewall is full with individual ips. I talked to my hosting company and asked them to block scrapers by checking their ip host but they said its not possible via firewall.
I wonder if there is any real solution available for this problem. I just don't want scrapers to hit my server.