stef25 - 12:04 pm on Jun 3, 2010 (gmt 0)
I'd like to hear people's thoughts on scraping websites.
In my country there are a few very large sites that are the "go to" sites for buying and renting real estate. They have been dominating the market for the past decade and they all have awful interfaces (cluttered, 25 mandatory fields in the search form etc)
I've been playing around with scraping and parsing those sites' results and storing them in my own DB. The idea is to publish this project as a sort of real estate "search engine" from where you can get results from all the big sites on one page.
Assuming I don't list any contact information and that users HAVE to follow my prominently displayed link back to the property detail page on the original site to reach the owner or agency that is selling / renting out the property, I think it's fair to say I'm just casting a wider net or "opening a additional shop front" for the original sites.
Would you as an owner of such a site object to my scraping and if so on what grounds?