delta-io / delta
An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs
☆7,440Updated this week
Related projects: ⓘ
- Apache Iceberg☆6,161Updated this week
- Upserts, Deletes And Incremental Processing on Big Data.☆5,330Updated this week
- Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.☆3,252Updated last week
- Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)☆10,189Updated this week
- Koalas: pandas API on Apache Spark☆3,329Updated 5 months ago
- Amundsen is a metadata driven application for improving the productivity of data analysts, data scientists and engineers when interacting…☆4,391Updated this week
- Apache Pinot - A realtime distributed OLAP datastore☆5,393Updated this week
- Apache Parquet Java☆2,558Updated 2 weeks ago
- Apache Beam is a unified programming model for Batch and Streaming data processing.☆7,772Updated this week
- The Metadata Platform for your Data Stack☆9,674Updated this week
- An Open Standard for lineage metadata collection☆1,708Updated this week
- Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.☆2,071Updated this week
- dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build application…☆9,626Updated this week
- Apache Parquet Format☆1,744Updated 3 weeks ago
- Open, Multi-modal Catalog for Data & AI☆2,222Updated this week
- Kubernetes operator for managing the lifecycle of Apache Spark applications on Kubernetes.☆2,744Updated this week
- The official home of the Presto distributed SQL query engine for big data☆15,919Updated this week
- Dremio - the missing link in modern data☆1,356Updated 2 weeks ago
- An open protocol for secure data sharing☆747Updated 3 weeks ago
- Apache Arrow is a multi-language toolbox for accelerated data interchange and in-memory processing☆14,283Updated this week
- Web-based notebook that enables data-driven, interactive data analytics and collaborative documents with SQL, Scala and more.☆6,374Updated this week
- Collect, aggregate, and visualize a data ecosystem's metadata☆1,732Updated this week
- Apache Calcite☆4,543Updated this week
- ☆1,606Updated this week
- A native Rust library for Delta Lake, with bindings into Python☆2,155Updated this week
- Apache Atlas☆1,813Updated 2 weeks ago
- Apache NiFi☆4,755Updated this week
- Apache Hive☆5,490Updated this week
- The Internals of Apache Spark☆1,461Updated this week
- REST job server for Apache Spark☆2,844Updated 2 months ago