How do I block a scraper?

[AnotherPerson]

I just discovered that someone (I know who) is using spyfu.com to gather data on many of my web sites. How can I block spyfu or stop them? It is extremely important that I do so ASAP.

Thanks.

[stapel]

AnotherPerson said: How can I block spyfu...?

If this "service" (which offers paid site-scraping, among other icky things) comes from a stable source (domain name, IP address(es), etc), then you might be able to block access by blocking it in your .htaccess file.

Eliz.

For specific information on blocking by IP address, etc, try the library for the "Apache Web Server [webmasterworld.com]" category.

[AnotherPerson]

At the moment, I can't tell how they scraped the site. I just know that an evil source used it. That source has already been blocked and yet spyfu still seems to get through. Any other other ideas?

[aruns]

There is no easy to block spyfu or any of the keyword spying cos. as they dont scrape your site, but scrape the search engines. What you can do is avoid using tracking urls with keywords in them. So these programs only throw up broad matched terms are for the most part useless. Hope this helps.

[tummblr]

Has anyone figured out the IP address(es) of Spyfu's bots/scrapers? We can use the IP Exclusion Tool in Google AdWords to prevent Spyfu from seeing our ads. If only we had Spyfu's IPs...

[MadeWillis]

Saw this article the other day. It doens't offer advice on how to block the bots, but I did agree with several points made.

[searchengineland.com...]