Skip to content

On my Om

On Technology & Change

  • Journal
  • Essays
  • Interviews
  • About
  • Newsletter
  • Search

My former colleague, Derrick Harris, wrote more about Hadoop than any other reporter, and today, he wrote a wonderful obituary of Hadoop. He goes step by step, through what has made Hadoop quite irrelevant.

Hadoop’s path to ubiquity intersected a host of other technology shifts that as a whole would prove to be more impactful in the long run, in part by peeling off the most valuable promises of big data and making them more consumable…..The story of Hadoop can help us understand why the world of data looks how it does today. It also should be a valuable lesson for anybody trying to make sense of the next big thing in enterprise IT, and the next one after that…….Hadoop opened people’s eyes to what was possible with big data, but it’s also a reminder that no single technology is going to remake the world of enterprise IT— at least not anymore.

Way back in 2008, when writing GigaOm, I hosted a meet-up for Hadoop enthusiasts, inspired by what I had seen Google and Yahoo do with data. The age of large data sets was ascendant, and it made perfect sense for a distributed file-system called Hadoop to emerge. However, the world changed too fast. The emergence of smartphones, the growing dominance of cloud and other meta-changes in the technology landscape radically redefined what data could do. And just as quickly as it became hot, Hadoop found itself on the outs, with its logo, The Elephant, ironically telling the story of its lumbering legacy.

Hadoop’s rise and irrelevance is the new reality of our cloud-centric world. It is also a reminder that new technology emerges and spread at lightning-fast speed, only to become irrelevant or eventually be subsumed by larger players. What is hot today, is a stock market detritus a decade later. In many ways, Cloudera is a perfect proxy for Hadoop, and what has gone wrong with the Hadoop ecosystem.

Meanwhile, Wall Street shark Carl Icahn is hot and heavy for Cloudera. The company, which recently got rid of its chief executive, and lost one of its co-founders, is now a Wall Street piñata. The stock which in March 2017 was around $22 a share hit an all-time low of approximately $5 a share, though it has since rebounded to about $7 a share. I am all eyes and ears to see how Icahn will make the elephant dance.

Read article on Derrick Harris

Letter from Om

A (nearly) daily dispatch about tech & future.

You will get my reporting, analysis, conversations, and curation of the essential information you need to make sense of the present future.

Check your inbox or spam folder to confirm your subscription.

My blog has an RSS feed. I am on Twitter @Om

***

Related Posts

  • In conversation with Nick Felton (@feltron)
  • Zimmerman’s Law: Data & its corrupting influence
  • Snap & Climate Change: Is there a link?

Read article on Derrick Harris

Om Malik

Om Malik is a San Francisco based writer, photographer and investor. More....

Post navigation

Previous Previous post: New Collaboration with Dsptch SF
Next Next post: The Weekend
  • Twitter
  • Instagram
  • RSS Feed
Powered by WordPress | Hosted by Pressable

Letter from Om

A (nearly) daily dispatch about tech & future.

You will get my reporting, analysis, conversations, and curation of the essential information you need to make sense of the present future.

Check your inbox or spam folder to confirm your subscription.

 Twitter
 Email