delta-io / delta-sharing

Related projects: ⓘ

• projectnessie / nessie
  Nessie: Transactional Catalog for Data Lakes with Git-like semantics
  ☆984Updated this week
• delta-io / connectors
  ☆375Updated this week
• OpenLineage / OpenLineage
  An Open Standard for lineage metadata collection
  ☆1,708Updated this week
• delta-io / kafka-delta-ingest
  A highly efficient daemon for streaming data from Kafka into Delta Lake
  ☆354Updated last week
• databrickslabs / dbldatagen
  Generate relevant synthetic data quickly for your projects. The Databricks Labs synthetic data generator (aka `dbldatagen`) may be used …
  ☆309Updated last week
• dbt-labs / dbt-spark
  dbt-spark contains all of the code enabling dbt to work with Apache Spark and Databricks
  ☆390Updated this week
• databrickslabs / dbx
  🧱 Databricks CLI eXtensions - aka dbx is a CLI tool for development and advanced Databricks workflows management.
  ☆438Updated last week
• odpi / egeria
  Egeria core
  ☆796Updated this week
• apache / iceberg-python
  Apache PyIceberg
  ☆385Updated this week
• awslabs / python-deequ
  Python API for Deequ
  ☆704Updated last week
• databricks / databricks-cli
  (Legacy) Command Line Interface for Databricks
  ☆383Updated 11 months ago
• tokern / data-lineage
  Generate and Visualize Data Lineage from query history
  ☆308Updated last year
• MarquezProject / marquez
  Collect, aggregate, and visualize a data ecosystem's metadata
  ☆1,732Updated last week
• databricks / databricks-sdk-py
  Databricks SDK for Python (Beta)
  ☆345Updated this week
• linkedin / openhouse
  Open Control Plane for Tables in Data Lakehouse
  ☆289Updated this week
• LucaCanali / sparkMeasure
  This is the development repository for sparkMeasure, a tool and library designed for efficient analysis and troubleshooting of Apache Spa…
  ☆692Updated last month
• apache / polaris
  The interoperable, open source catalog for Apache Iceberg
  ☆1,012Updated this week
• microsoft / hyperspace
  An open source indexing subsystem that brings index-based query acceleration to Apache Spark™ and big data workloads.
  ☆423Updated 2 years ago
• MrPowers / chispa
  PySpark test helper methods with beautiful error messages
  ☆583Updated last week
• snowflakedb / spark-snowflake
  Snowflake Data Source for Apache Spark.
  ☆213Updated this week
• sodadata / soda-core
  Data quality testing for the modern data stack (SQL, Spark, and Pandas) https://www.soda.io
  ☆1,866Updated last week
• unitycatalog / unitycatalog
  Open, Multi-modal Catalog for Data & AI
  ☆2,222Updated this week
• datamechanics / delight
  A Spark UI and Spark History Server alternative with CPU and Memory metrics! Delight is free, cross-platform, and open-source.
  ☆341Updated 3 months ago
• MrPowers / mack
  Delta Lake helper methods in PySpark
  ☆294Updated 2 weeks ago
• TobikoData / sqlmesh
  Efficient data transformation and modeling framework that is backwards compatible with dbt.
  ☆1,612Updated this week
• astronomer / astro-sdk
  Astro SDK allows rapid and clean development of {Extract, Load, Transform} workflows using Python and SQL, powered by Apache Airflow.
  ☆340Updated this week
• databrickslabs / tempo
  API for manipulating time series on top of Apache Spark: lagged time values, rolling statistics (mean, avg, sum, count, etc), AS OF joins…
  ☆306Updated last month
• YotpoLtd / metorikku
  A simplified, lightweight ETL Framework based on Apache Spark
  ☆581Updated 7 months ago
• astronomer / astro-cli
  CLI that makes it easy to create, test and deploy Airflow DAGs to Astronomer
  ☆348Updated this week
• paypal / data-contract-template
  Template for a data contract used in a data mesh.
  ☆458Updated 6 months ago