Welcome to WebmasterWorld Guest from 50.19.34.234

Forum Moderators: LifeinAsia & httpwebwitch

Message Too Old, No Replies

scrapers at the next level

selling their services/data

     

LifeinAsia

6:03 pm on Jul 23, 2010 (gmt 0)

WebmasterWorld Administrator lifeinasia is a WebmasterWorld Top Contributor of All Time 5+ Year Member Top Contributors Of The Month



So the scrapers have "evolved" beyond just scraping sites and putting up copied sites. I just came across a scraper who is selling their scraped data and even their services for scraping dozens of the largest sites, including one that belongs to a client.

Came across the advertisement on Alibaba, but it's an Indian company.

aspdaddy

5:56 pm on Jul 24, 2010 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



They evolved a long time ago. There any many legitimate uses of scraping and scraping services are very common.

Many of the popular SEO tools and site analysers use it to automate manual tasks.

Many search engines use it to provide previews of pages before navigating to them

Then there's the open source crowd and scrapeforge.

Most of us have likely bought scraped data and content at some point and not even known.

enigma1

2:19 pm on Jul 31, 2010 (gmt 0)

WebmasterWorld Senior Member 5+ Year Member



yes they have evolved and unless the search engines stop giving them incentives for scrapping, expect this phenomenon to grow further.

incrediBILL

2:30 pm on Jul 31, 2010 (gmt 0)

WebmasterWorld Administrator incredibill is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



unless the search engines stop giving them incentives for scrapping


The SEs are the biggest scrapers around and some of them, like GigaBlast or Majestic, specialize in selling their data more than being a search engine itself.

All I know is the little scrapers aren't scraping me :)

enigma1

4:10 pm on Jul 31, 2010 (gmt 0)

WebmasterWorld Senior Member 5+ Year Member



there you go Bill, another way of saying it, although I was referring to the handful of the top search engines. They have ways of identifying the content author but they prefer to do otherwise.
 

Featured Threads

Hot Threads This Week

Hot Threads This Month