delta-io / delta
An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs
☆7,608Updated this week
Related projects ⓘ
Alternatives and complementary repositories for delta
- Apache Iceberg☆6,473Updated this week
- Upserts, Deletes And Incremental Processing on Big Data.☆5,444Updated this week
- Apache Parquet Java☆2,642Updated this week
- Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)☆10,477Updated this week
- Apache Pinot - A realtime distributed OLAP datastore☆5,517Updated this week
- Apache Parquet Format☆1,810Updated last week
- Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.☆3,309Updated last month
- Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.☆2,105Updated this week
- An open protocol for secure data sharing☆770Updated last week
- Dremio - the missing link in modern data☆1,381Updated 3 weeks ago
- An Open Standard for lineage metadata collection☆1,772Updated this week
- A native Rust library for Delta Lake, with bindings into Python☆2,325Updated this week
- Amundsen is a metadata driven application for improving the productivity of data analysts, data scientists and engineers when interacting…☆4,440Updated last week
- Apache DataFusion SQL Query Engine☆6,312Updated this week
- A composable and fully extensible C++ execution engine library for data management systems.☆3,520Updated this week
- Apache Atlas☆1,838Updated this week
- Open, Multi-modal Catalog for Data & AI☆2,432Updated this week
- ☆1,610Updated last week
- Apache Calcite☆4,615Updated this week
- Gluten is a middle layer responsible for offloading JVM-based SQL engines' execution to native engines.☆1,212Updated this week
- Nessie: Transactional Catalog for Data Lakes with Git-like semantics☆1,040Updated this week
- Collect, aggregate, and visualize a data ecosystem's metadata☆1,781Updated last week
- Mirror of Apache Kudu☆1,850Updated this week
- Web-based notebook that enables data-driven, interactive data analytics and collaborative documents with SQL, Scala and more.☆6,415Updated this week
- The Open Source Feature Store for Machine Learning☆5,613Updated this week
- Apache Hive☆5,555Updated this week
- Apache Drill is a distributed MPP query layer for self describing data☆1,948Updated this week
- Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics☆14,615Updated this week
- The Metadata Platform for your Data and AI Stack☆9,922Updated this week