delta-io / deltaLinks
An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs
☆8,512Updated this week
Alternatives and similar repositories for delta
Users that are interested in delta are comparing it to the libraries listed below
Sorting:
- Upserts, Deletes And Incremental Processing on Big Data.☆6,061Updated this week
- Apache Iceberg☆8,413Updated this week
- Apache Parquet Java☆3,007Updated this week
- Amundsen is a metadata driven application for improving the productivity of data analysts, data scientists and engineers when interacting…☆4,712Updated this week
- An Open Standard for lineage metadata collection☆2,255Updated this week
- Open, Multi-modal Catalog for Data & AI☆3,255Updated this week
- Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.☆3,567Updated 2 months ago
- Apache Pinot - A realtime distributed OLAP datastore☆6,007Updated this week
- Apache Parquet Format☆2,176Updated 2 weeks ago
- An open protocol for secure data sharing☆914Updated this week
- A native Rust library for Delta Lake, with bindings into Python☆3,094Updated this week
- Apache Beam is a unified programming model for Batch and Streaming data processing.☆8,445Updated this week
- Collect, aggregate, and visualize a data ecosystem's metadata☆2,092Updated this week
- Apache Atlas - Open Metadata Management and Governance capabilities across the Hadoop platform and beyond☆2,054Updated last week
- The Metadata Platform for your Data and AI Stack☆11,421Updated this week
- Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)☆12,388Updated this week
- A composable and fully extensible C++ execution engine library for data management systems.☆4,010Updated this week
- Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.☆2,287Updated last week
- Nessie: Transactional Catalog for Data Lakes with Git-like semantics☆1,395Updated this week
- Dremio - the missing link in modern data☆1,460Updated 3 months ago
- Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch …☆3,151Updated this week
- Gluten is a middle layer responsible for offloading JVM-based SQL engines' execution to native engines.☆1,495Updated this week
- lakeFS - Data version control for your data lake | Git for data☆5,082Updated this week
- ☆1,686Updated 3 weeks ago
- dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build application…☆12,057Updated this week
- Apache Polaris, the interoperable, open source catalog for Apache Iceberg☆1,799Updated this week
- A distributed data integration framework that simplifies common aspects of big data integration such as data ingestion, replication, orga…☆2,258Updated 3 weeks ago
- Apache Impala☆1,263Updated last week
- Data quality testing for the modern data stack (SQL, Spark, and Pandas) https://www.soda.io☆2,271Updated this week
- Apache Calcite☆5,031Updated this week