Posted by: Stephen Baker on February 01
Both Yahoo and Microsoft are building server farms on the Columbia River (and elsewhere) to try to keep up with Google in cloud computing. Just staying in this game requires cap investments at a minimum of $2 billion per year. Microsoft can afford it; Yahoo can’t.
And together? If this deal goes through, how these two companies will integrate their clouds is a big question, and a significant challenge. They’re different architectures and run on different software. This means that while Google races ahead, pouring billions into new server farms and sticking with its tried-and-true architecture, Microsoft will face a giant tech integration challenge.
One key question: Yahoo carries out much of the development of an open-source cloud platform, Hadoop, which is based on Google’s proprietary MapReduce. Hadoop’s founder, Doug Cutting, is a Yahoo employee, and told me in December that the development relied too much on Yahoo’s core team. Will Microsoft adopt this cloud open-source standard—a flavor of Google? Or will the software giant perhaps try to smother Hadoop in its crib? It’s also a question for other open-source initiatives at Yahoo, as noted by commenters in Jeremy’s blog.
re: "Hadoop, which is based on Google's proprietary MapReduce..."
This is a technicality, but I think it's more accurate to say that Hadoop implements the MapReduce interface, which Google has made available for its proprietary code.
The problem is the word "based" -- the way I first read it, I thought you meant that Yahoo had derived the code from Google. I don't think you meant that.
Actually, Jon, it's much more than interface. Hadoop started out as an open-source version of mapreduce. This was before most of the hadoop team began working at Yahoo. It can evolve along different paths, but it's based on map reduce, and Google engineers cooperated with the Hadoop team to steer them along the right path.
As Humphrey Bogart said, I was misinformed. I did trip over that sentences and hunted around online for what I thought was an explanation. Thanks for clarifying.
In Blogspotting Senior Writer Stephen Baker and Associate Editor Heather Green take a look at how cutting-edge technologies are changing business and society. Whether its blogs or wikis, data crunching or data targeting, technology’s advances are reshaping the world that we live in.