logo
logo

Spark fragmentation undermines community

avatar
Manuel Darcangelo
img

The Hadoop distribution war comes down to a final battle between Cloudera s CDH and Hortonworks HDP.

Indeed, it s competition that leads to end users getting the best possible products in their hands.

In June of last year Derek Wood, a DevOps Engineer at Cask, wrote a blog showing which versions of various software packages were supported by which versions of HDP and CDH.

Over the course of the past year I ve become increasingly concerned that the Apache Spark ecosystem will go the way of Hadoop before it.

Although Apache Spark is just four years old, we re already at the point where a few vendors are looking to sell Apache Spark to customers in different formats.

Open-source ideals are frequently sacrificed on the altar of creating an easily packaged product that can be sold to generate short-term profits.

collect
0
avatar
Manuel Darcangelo
guide
Zupyak is a free content platform for publishing and discovering stories, software and startups.