Welcome to WebmasterWorld Guest from 54.156.36.82

Forum Moderators: LifeinAsia

Message Too Old, No Replies

scrapers at the next level

selling their services/data

     
6:03 pm on Jul 23, 2010 (gmt 0)

Moderator This Forum from US 

WebmasterWorld Administrator lifeinasia is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Dec 10, 2005
posts:5683
votes: 79


So the scrapers have "evolved" beyond just scraping sites and putting up copied sites. I just came across a scraper who is selling their scraped data and even their services for scraping dozens of the largest sites, including one that belongs to a client.

Came across the advertisement on Alibaba, but it's an Indian company.
5:56 pm on July 24, 2010 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:June 13, 2002
posts:2162
votes: 0


They evolved a long time ago. There any many legitimate uses of scraping and scraping services are very common.

Many of the popular SEO tools and site analysers use it to automate manual tasks.

Many search engines use it to provide previews of pages before navigating to them

Then there's the open source crowd and scrapeforge.

Most of us have likely bought scraped data and content at some point and not even known.
2:19 pm on July 31, 2010 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Apr 30, 2007
posts:1394
votes: 0


yes they have evolved and unless the search engines stop giving them incentives for scrapping, expect this phenomenon to grow further.
2:30 pm on July 31, 2010 (gmt 0)

Administrator from US 

WebmasterWorld Administrator incredibill is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Jan 25, 2005
posts:14663
votes: 99


unless the search engines stop giving them incentives for scrapping


The SEs are the biggest scrapers around and some of them, like GigaBlast or Majestic, specialize in selling their data more than being a search engine itself.

All I know is the little scrapers aren't scraping me :)
4:10 pm on July 31, 2010 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Apr 30, 2007
posts:1394
votes: 0


there you go Bill, another way of saying it, although I was referring to the handful of the top search engines. They have ways of identifying the content author but they prefer to do otherwise.
 

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members