Unifying cloud storage and data warehouses: Delta Lake project hosted by the Linux Foundation
Summary
Zaharia and Databricks CEO and co-founder Ali Ghodsi are the original creators of the open source Apache Spark project, the unified analytics engine that has become a defacto standard for large-scale data processing. Coupled with an open governance model that encourages participation and technical contribution, this may mean that Delta Lake does indeed become a standard for storing big data. For a vendor like Tableau, on the other hand, being able to access and integrate data that lives in cloud storage vastly expands the reach of its users. This goes to show the philosophy on which Databricks operates: tackle problems faced by customers, open source solutions to foster adoption and innovation, integrate and build proprietary extensions, offer as a service. Judging from the numbers Zaharia shared, this seems to be working well for Databricks: three-fold increase in customer base, over $100 million in revenue, and an event which has grown in attendance from 1500 to 2100 people in one year.