Welcome to WebmasterWorld Guest from 50.17.5.36

Forum Moderators: martinibuster

Message Too Old, No Replies

Yahoo Launches Distributed Computing Initiative

     
2:21 pm on Nov 12, 2007 (gmt 0)

Administrator from GB 

WebmasterWorld Administrator engine is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:May 9, 2000
posts:22305
votes: 239


Yahoo Inc said on Monday it would launch an open source program for developing software for distributed computing, with Carnegie Mellon University as its first academic partner in the venture.

Yahoo has been a main supporter of Hadoop, an open source distributed file system that lets users process massive amounts of data. The company said it would make Hadoop available to academic research in a supercomputing-class data center.

Yahoo Launches Distributed Computing Initiative [reuters.com]

3:09 pm on Nov 12, 2007 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Aug 8, 2004
posts:1679
votes: 0


It is interesting that Hadoop is actually an implementation of Google's Map Reduce. Very shrewd move by Yahoo to support Hadoop rather than copying Map Reduce directly, same result but face is saved :)

It also has to be noted here that this "distributed" thing is not what normally people might think of hearing about distributed computing, ie SETI@home and others - Hadoop is a file system and it won't work well over puny Internet connections, so this is really a LAN (1 Gbit+) solution, and really you would do well with 10 Gbit one.