Yahoo's Failed Google Fight Helped Create the Big-Data Ecosystem
Yahoo's attempt to reproduce Google's search infrastructure funded Hadoop, an open-source recreation inspired by Google's published work on its file system and MapReduce. The technology later supported data-intensive products across the Web 2.0 ecosystem, making Yahoo's failed competitive campaign unexpectedly valuable to the broader startup world.
- Google developed its file system and MapReduce for massive-scale computation.
- Yahoo funded Doug Cutting's Hadoop work.
- Hadoop gave outside companies access to big-data infrastructure concepts.
- Facebook and later marketplace companies benefited from the open-source ecosystem.
- Hortonworks and Cloudera emerged from this lineage.
“the most important thing to me that comes out of Yahoo's attempts to compete with Google is Hadoop.”
“This technology that gets open sourced was all of Google's core technology innovation.”