Forum Moderators: open

Message Too Old, No Replies

Using ASP Scraper for Search Engine Benefits

         

flyerguy

9:31 pm on Sep 9, 2004 (gmt 0)

10+ Year Member



I have an ASP .net script which quickly pulls up an external URL and displays it's contents under my own. I have seen many sites which use framesets and call up an foreign URL, so i'm assuming that technique is copyright-safe.

My specific use is I want to make an index of school websites across north america. The top part would be my content, logo and state/province index. The bottom part would be the scraped content of the particular schools URL.

a) If I have more than 50%-60% of total page content as my own original material, will it beat google/other SE's duplicate content filters? (aka is there any benefit to doing this as far as becoming an authority site)

b) Am I infringing on the copyright of the scraped websites? Is there any legal precedent for this?

In the end, it has the same effect of displaying an external URL via a frameset; you are displaying someone else's site in your own context. I can't see how the fact that it is browser or server generated being fathomed by a judge..

Webwork

11:14 pm on Sep 10, 2004 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



You won't be the first person sued for attempting to profit by framing a third-party's site. Essentially, you profitting by virtue of imbedding someone else's work on 'your site'.

Webwork, Esq. (my other job)

flyerguy

10:20 am on Sep 11, 2004 (gmt 0)

10+ Year Member



I just want to establish whether it is indeed illegal to frameset and external site. I see a leader in a certain sector doing this on over 1900 pages and they have PR assigned and do quite well. He adds his own keywords and site title on the top frame and pulls up the target site below.

And what about hotmail/ask's method of keeping their frame on top when you hit an external link? As long as I followed their format and didn't palce advertising it could hardly be considered 'profiting' off the other site.

mincklerstraat

3:47 pm on Sep 11, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Don't do this until you've researched the copyright issues thoroughly. Your posting here is, I guess, part of this research - but get advice from other sources than here, too - like google 'copyright frames lawsuit' (put the lawsuit in there just so you don't get all the results that have frames in the url, or frames messages, and a copyright statement on the bottom) - first I pull up is [gigalaw.com...] ,
which definitely advises exercising caution and making sure you make it more than apparent to everyone visiting your site that the specified content *is not yours.*

Also, frames can have issues when it comes to search engine rankings. Be advised.

A competitors' doing well at this moment in the se's is no guarantee that the practice is a good practice, nor that the competitor will continue to good in se's.

Finally, using a framset, which you mention here, is a completely different animal than 'screenscraping.' Framesets are highly questionable when it comes to copyrights - and screenscraping is strictly prohibited, beyond what could be considered 'fair use' (which is very, very limited, and very, very shaky ground).

Best practices: get permission for whatever you do. You are probably not in a position to compare yourself to the search engines you cite; and if you think you are, make sure you provide very, very explicit grounds for this.

flyerguy

4:13 pm on Sep 11, 2004 (gmt 0)

10+ Year Member



Thanks for your response. Of course I am wary of doing anything based solely on seeing someone else doing it, especially with the flexible nature of SE's regulations.

I have decided that as with most shaky black hat stuff, i'd rather sleep well by making a %100 legit site with harder work thats guaranteed not to kicked for illicit practices.

mincklerstraat

10:45 pm on Sep 11, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Here here. Very good idea. Legit pays better in the long run.