delta-io / delta-sharing

Related projects ⓘ

Alternatives and complementary repositories for delta-sharing

• projectnessie / nessie
  Nessie: Transactional Catalog for Data Lakes with Git-like semantics
  ☆1,040Updated this week
• OpenLineage / OpenLineage
  An Open Standard for lineage metadata collection
  ☆1,772Updated this week
• apache / polaris
  Apache Polaris, the interoperable, open source catalog for Apache Iceberg
  ☆1,158Updated this week
• delta-io / kafka-delta-ingest
  A highly efficient daemon for streaming data from Kafka into Delta Lake
  ☆369Updated last week
• dbt-labs / dbt-spark
  dbt-spark contains all of the code enabling dbt to work with Apache Spark and Databricks
  ☆405Updated last week
• apache / iceberg-python
  Apache PyIceberg
  ☆473Updated this week
• microsoft / hyperspace
  An open source indexing subsystem that brings index-based query acceleration to Apache Spark™ and big data workloads.
  ☆424Updated 2 years ago
• MarquezProject / marquez
  Collect, aggregate, and visualize a data ecosystem's metadata
  ☆1,781Updated last week
• datamechanics / delight
  A Spark UI and Spark History Server alternative with CPU and Memory metrics! Delight is free, cross-platform, and open-source.
  ☆342Updated 5 months ago
• linkedin / openhouse
  Open Control Plane for Tables in Data Lakehouse
  ☆312Updated this week
• apache / datafusion-comet
  Apache DataFusion Comet Spark Accelerator
  ☆821Updated this week
• awslabs / python-deequ
  Python API for Deequ
  ☆730Updated last month
• snowflakedb / spark-snowflake
  Snowflake Data Source for Apache Spark.
  ☆218Updated this week
• sodadata / soda-core
  Data quality testing for the modern data stack (SQL, Spark, and Pandas) https://www.soda.io
  ☆1,913Updated this week
• MrPowers / chispa
  PySpark test helper methods with beautiful error messages
  ☆621Updated 3 weeks ago
• tokern / data-lineage
  Generate and Visualize Data Lineage from query history
  ☆311Updated last year
• AbsaOSS / spline
  Data Lineage Tracking And Visualization Solution
  ☆604Updated this week
• TobikoData / sqlmesh
  Efficient data transformation and modeling framework that is backwards compatible with dbt.
  ☆1,824Updated this week
• eakmanrq / sqlframe
  Turning PySpark Into a Universal DataFrame API
  ☆323Updated this week
• LucaCanali / sparkMeasure
  This is the development repository for sparkMeasure, a tool and library designed for efficient analysis and troubleshooting of Apache Spa…
  ☆707Updated 3 months ago
• microsoft / sql-spark-connector
  Apache Spark Connector for SQL Server and Azure SQL
  ☆275Updated 3 months ago
• YotpoLtd / metorikku
  A simplified, lightweight ETL Framework based on Apache Spark
  ☆584Updated 9 months ago
• substrait-io / substrait
  A cross platform way to express data transformation, relational algebra, standardized record expression and plans.
  ☆1,205Updated this week
• unitycatalog / unitycatalog
  Open, Multi-modal Catalog for Data & AI
  ☆2,432Updated this week