Forum Moderators: phranque

Message Too Old, No Replies

Dealing with scrapers

         

Tonearm

2:53 pm on Nov 10, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



How do you guys deal with scrapers? There's one that's been hitting up my site for quite a while now. The first 3 sections of the IP are the same but the last section always changes. I hate to block anybody by IP because of the potential for blocking a real user, but maybe that's the only way? If so, what is the best way to do that in apache2?

Tonearm

9:07 pm on Nov 12, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Do you guys block scrapers by IP?

Bewenched

9:52 pm on Nov 12, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Generally blocking them by their IP is simply a bandaid approach as they tend to jump around. You should check out Incredibills blog on the subject. incredibill.blogspot.com

Tonearm

2:35 pm on Nov 13, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Incredibill has 53 articles on scrapers. Could you give me a clue as to which one you're referring to? Maybe a keyword?