Welcome to WebmasterWorld Guest from 34.238.194.166

Forum Moderators: phranque

Message Too Old, No Replies

Speed of File Sharing May Get a Boost with 'SET'

     
11:17 am on Apr 13, 2007 (gmt 0)

Administrator from GB 

WebmasterWorld Administrator engine is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month Best Post Of The Month

joined:May 9, 2000
posts:26241
votes: 999


Movies and music could be shared faster over the net thanks to a system pioneered by researchers in the US.
The speed of current services, like BitTorrent, is limited by the number of people sharing a specific file, such as a movie or song.

Similarity-Enhanced Transfer (SET) works by spotting chunks of identical data in files that are an exact or near match to the one needed. Using SET the researchers have seen speed increases of up to 500%.


Speed of File Sharing May Get a Boost with 'SET' [news.bbc.co.uk]
6:24 pm on Apr 13, 2007 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:June 29, 2001
posts:2145
votes: 0


Wow, that will kill the movie studios.

Very interesting post.

7:49 pm on Apr 13, 2007 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Mar 4, 2004
posts:892
votes: 3


Wow, that will kill the movie studios.

The movie studios are killing themselves trying to stop such technology instead of embracing it.

6:11 pm on Apr 14, 2007 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Jan 30, 2001
posts:1739
votes: 0


You can get the same speedup by zipping a file up, three times in succession. ;)
10:18 pm on Apr 14, 2007 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Mar 4, 2004
posts:892
votes: 3


The second and third compression will provide little space savings, even the first compression will provide little benefit if the files you are compressing are already compressed like .jpg's . Text files on the other hand compress very well.
2:54 am on Apr 15, 2007 (gmt 0)

Senior Member

WebmasterWorld Senior Member tedster is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:May 26, 2000
posts:37301
votes: 0


This advance is a bit different --

SET works faster because... many files being shared on the net contain identical pieces of data even though they appear to be different...

The SET system assigns files a similarity ranking and can take chunks of data from files which are both identical and similar to the one being searched for....

SET uses a technique called handprinting... to seek out files that contain some of the data needed by the one a file-sharing program has requested.

For example, a search for a particular Madonna song may result in a wide range of titles because the tags, or labels, have been filled in differently, or incorrectly.

So it's not exactly a new compression scheme, but a scheme that identifies subsititute source files that don't immediately appear to be the same.

 

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members