The Two Flavors of Google — Nice article on Hadoop
Nice article on Hadoop at Business Week and some good quotes from Lucene Java creator Doug Cutting. Hadoop holds a lot of promise for the future of large scale computing, although I don’t want to burden it with that kind of claim, either. In the end, it makes solving a good deal of hard problems much easier by providing an easy to use framework for distributing data and tasks across multiple computers.
To go with Hadoop, a group of developers and I are in the process of starting up a machine learning project based on Hadoop, called Mahout. You can learn more about it here. Many of these machine learning algorithms are the real guts of what makes companies like Google tick, since the leverage Map-Reduce to do interesting things. Providing a high-quality, scalable, commercial friendly implementation of commonly used machine learning algorithms should further unlock the mysteries of Google and companies like it to provide these capabilities to the masses and spur on new innovation in the space. More news to follow as we work to get this project off the ground.
