Welcome to WebmasterWorld Guest from 54.144.126.195

Forum Moderators: martinibuster

Message Too Old, No Replies

Yahoo Launches Distributed Computing Initiative

     

engine

2:21 pm on Nov 12, 2007 (gmt 0)

WebmasterWorld Administrator engine is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



Yahoo Inc said on Monday it would launch an open source program for developing software for distributed computing, with Carnegie Mellon University as its first academic partner in the venture.

Yahoo has been a main supporter of Hadoop, an open source distributed file system that lets users process massive amounts of data. The company said it would make Hadoop available to academic research in a supercomputing-class data center.

Yahoo Launches Distributed Computing Initiative [reuters.com]

Lord Majestic

3:09 pm on Nov 12, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



It is interesting that Hadoop is actually an implementation of Google's Map Reduce. Very shrewd move by Yahoo to support Hadoop rather than copying Map Reduce directly, same result but face is saved :)

It also has to be noted here that this "distributed" thing is not what normally people might think of hearing about distributed computing, ie SETI@home and others - Hadoop is a file system and it won't work well over puny Internet connections, so this is really a LAN (1 Gbit+) solution, and really you would do well with 10 Gbit one.

 

Featured Threads

Hot Threads This Week

Hot Threads This Month