delta-io / delta-sharing
An open protocol for secure data sharing
☆805Updated 3 weeks ago
Alternatives and similar repositories for delta-sharing:
Users that are interested in delta-sharing are comparing it to the libraries listed below
- Nessie: Transactional Catalog for Data Lakes with Git-like semantics☆1,129Updated this week
- A highly efficient daemon for streaming data from Kafka into Delta Lake☆390Updated 3 weeks ago
- An Open Standard for lineage metadata collection☆1,848Updated this week
- dbt-spark contains all of the code enabling dbt to work with Apache Spark and Databricks☆419Updated last week
- Collect, aggregate, and visualize a data ecosystem's metadata☆1,841Updated last week
- Python API for Deequ☆744Updated 4 months ago
- An open source indexing subsystem that brings index-based query acceleration to Apache Spark™ and big data workloads.☆424Updated 3 years ago
- Apache Polaris, the interoperable, open source catalog for Apache Iceberg☆1,346Updated this week
- Data quality testing for the modern data stack (SQL, Spark, and Pandas) https://www.soda.io☆2,016Updated this week
- Dremio - the missing link in modern data☆1,409Updated 3 months ago
- Open Control Plane for Tables in Data Lakehouse☆323Updated last week
- Apache PyIceberg☆596Updated this week
- Apache DataFusion Comet Spark Accelerator☆890Updated this week
- PySpark test helper methods with beautiful error messages☆663Updated last month
- Data Lineage Tracking And Visualization Solution☆612Updated 2 weeks ago
- A simplified, lightweight ETL Framework based on Apache Spark☆586Updated last year
- Template for a data contract used in a data mesh.☆467Updated 11 months ago
- Open, Multi-modal Catalog for Data & AI☆2,665Updated this week
- Delta Lake helper methods in PySpark☆315Updated 5 months ago
- Efficient data transformation and modeling framework that is backwards compatible with dbt.☆2,081Updated this week
- Snowflake Data Source for Apache Spark.☆224Updated 2 months ago
- re_data - fix data issues before your users & CEO would discover them 😊☆1,565Updated 9 months ago
- Gluten is a middle layer responsible for offloading JVM-based SQL engines' execution to native engines.☆1,265Updated this week
- Port(ish) of Great Expectations to dbt test macros☆1,141Updated 2 months ago
- The Trino (https://trino.io/) adapter plugin for dbt (https://getdbt.com)☆226Updated 2 months ago
- A Spark UI and Spark History Server alternative with CPU and Memory metrics! Delight is free, cross-platform, and open-source.☆345Updated 8 months ago
- The Lakehouse Engine is a configuration driven Spark framework, written in Python, serving as a scalable and distributed engine for sever…☆234Updated 2 weeks ago
- Turning PySpark Into a Universal DataFrame API☆366Updated this week
- ☆258Updated 3 months ago
- This is the development repository for sparkMeasure, a tool and library designed for efficient analysis and troubleshooting of Apache Spa…☆727Updated 2 weeks ago