delta-io / delta
An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs
☆7,876Updated this week
Alternatives and similar repositories for delta:
Users that are interested in delta are comparing it to the libraries listed below
- Upserts, Deletes And Incremental Processing on Big Data.☆5,690Updated this week
- Apache Iceberg☆7,019Updated this week
- Apache Parquet Java☆2,755Updated this week
- Open, Multi-modal Catalog for Data & AI☆2,720Updated this week
- An open protocol for secure data sharing☆814Updated this week
- Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.☆3,379Updated 2 weeks ago
- A composable and fully extensible C++ execution engine library for data management systems.☆3,654Updated this week
- Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.☆2,161Updated this week
- A native Rust library for Delta Lake, with bindings into Python☆2,621Updated this week
- Amundsen is a metadata driven application for improving the productivity of data analysts, data scientists and engineers when interacting…☆4,530Updated last week
- An Open Standard for lineage metadata collection☆1,873Updated this week
- Web-based notebook that enables data-driven, interactive data analytics and collaborative documents with SQL, Scala and more.☆6,468Updated this week
- Apache Parquet Format☆1,903Updated 2 weeks ago
- Apache Atlas - Open Metadata Management and Governance capabilities across the Hadoop platform and beyond☆1,908Updated this week
- Dremio - the missing link in modern data☆1,415Updated 4 months ago
- Apache Drill is a distributed MPP query layer for self describing data☆1,960Updated last week
- Data quality testing for the modern data stack (SQL, Spark, and Pandas) https://www.soda.io☆2,042Updated this week
- Collect, aggregate, and visualize a data ecosystem's metadata☆1,877Updated this week
- Kubernetes operator for managing the lifecycle of Apache Spark applications on Kubernetes.☆2,877Updated last week
- Apache Beam is a unified programming model for Batch and Streaming data processing.☆8,039Updated this week
- Apache DataFusion SQL Query Engine☆6,887Updated this week
- Nessie: Transactional Catalog for Data Lakes with Git-like semantics☆1,158Updated this week
- Apache Impala☆1,194Updated this week
- Apache NiFi☆5,165Updated this week
- Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)☆10,985Updated this week
- Mirror of Apache Kudu☆1,862Updated this week
- ☆1,630Updated this week
- Gluten is a middle layer responsible for offloading JVM-based SQL engines' execution to native engines.☆1,290Updated this week
- A distributed data integration framework that simplifies common aspects of big data integration such as data ingestion, replication, orga…☆2,237Updated last week
- Apache Polaris, the interoperable, open source catalog for Apache Iceberg☆1,381Updated this week