delta-io / deltaLinks
An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs
☆8,041Updated this week
Alternatives and similar repositories for delta
Users that are interested in delta are comparing it to the libraries listed below
Sorting:
- Apache Iceberg☆7,464Updated this week
- Upserts, Deletes And Incremental Processing on Big Data.☆5,795Updated this week
- Apache Parquet Java☆2,826Updated this week
- Amundsen is a metadata driven application for improving the productivity of data analysts, data scientists and engineers when interacting…☆4,580Updated 2 weeks ago
- Apache Pinot - A realtime distributed OLAP datastore☆5,785Updated this week
- Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.☆2,188Updated this week
- Apache Parquet Format☆1,953Updated 2 weeks ago
- Dremio - the missing link in modern data☆1,430Updated 3 weeks ago
- Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.☆3,425Updated last month
- Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)☆11,349Updated this week
- An open protocol for secure data sharing☆836Updated this week
- Apache Calcite☆4,841Updated last week
- The Metadata Platform for your Data and AI Stack☆10,644Updated last week
- Collect, aggregate, and visualize a data ecosystem's metadata☆1,924Updated this week
- An Open Standard for lineage metadata collection☆1,943Updated this week
- Open, Multi-modal Catalog for Data & AI☆2,877Updated last week
- Apache Atlas - Open Metadata Management and Governance capabilities across the Hadoop platform and beyond☆1,939Updated last week
- Apache Hive☆5,711Updated this week
- dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build application…☆10,865Updated this week
- A native Rust library for Delta Lake, with bindings into Python☆2,801Updated this week
- Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics☆15,481Updated this week
- Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch …☆2,807Updated this week
- Apache DataFusion SQL Query Engine☆7,250Updated this week
- ☆1,654Updated 2 weeks ago
- Apache Beam is a unified programming model for Batch and Streaming data processing.☆8,120Updated this week
- Apache Drill is a distributed MPP query layer for self describing data☆1,973Updated last week
- A composable and fully extensible C++ execution engine library for data management systems.☆3,752Updated this week
- The official home of the Presto distributed SQL query engine for big data☆16,344Updated this week
- Web-based notebook that enables data-driven, interactive data analytics and collaborative documents with SQL, Scala and more.☆6,488Updated this week
- Nessie: Transactional Catalog for Data Lakes with Git-like semantics☆1,215Updated last week