homepage Welcome to WebmasterWorld Guest from 54.227.34.0
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor 2014
Home / Forums Index / WebmasterWorld / Professional Webmaster Business Issues
Forum Library, Charter, Moderators: LifeinAsia & httpwebwitch

Professional Webmaster Business Issues Forum

    
scrapers at the next level
selling their services/data
LifeinAsia

WebmasterWorld Administrator lifeinasia us a WebmasterWorld Top Contributor of All Time 5+ Year Member



 
Msg#: 4175477 posted 6:03 pm on Jul 23, 2010 (gmt 0)

So the scrapers have "evolved" beyond just scraping sites and putting up copied sites. I just came across a scraper who is selling their scraped data and even their services for scraping dozens of the largest sites, including one that belongs to a client.

Came across the advertisement on Alibaba, but it's an Indian company.

 

aspdaddy

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 4175477 posted 5:56 pm on Jul 24, 2010 (gmt 0)

They evolved a long time ago. There any many legitimate uses of scraping and scraping services are very common.

Many of the popular SEO tools and site analysers use it to automate manual tasks.

Many search engines use it to provide previews of pages before navigating to them

Then there's the open source crowd and scrapeforge.

Most of us have likely bought scraped data and content at some point and not even known.

enigma1

WebmasterWorld Senior Member 5+ Year Member



 
Msg#: 4175477 posted 2:19 pm on Jul 31, 2010 (gmt 0)

yes they have evolved and unless the search engines stop giving them incentives for scrapping, expect this phenomenon to grow further.

incrediBILL

WebmasterWorld Administrator incredibill us a WebmasterWorld Top Contributor of All Time 5+ Year Member Top Contributors Of The Month



 
Msg#: 4175477 posted 2:30 pm on Jul 31, 2010 (gmt 0)

unless the search engines stop giving them incentives for scrapping


The SEs are the biggest scrapers around and some of them, like GigaBlast or Majestic, specialize in selling their data more than being a search engine itself.

All I know is the little scrapers aren't scraping me :)

enigma1

WebmasterWorld Senior Member 5+ Year Member



 
Msg#: 4175477 posted 4:10 pm on Jul 31, 2010 (gmt 0)

there you go Bill, another way of saying it, although I was referring to the handful of the top search engines. They have ways of identifying the content author but they prefer to do otherwise.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / WebmasterWorld / Professional Webmaster Business Issues
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved