awslabs / python-deequ

Related projects ⓘ

Alternatives and complementary repositories for python-deequ

• MrPowers / chispa
  PySpark test helper methods with beautiful error messages
  ☆621Updated 3 weeks ago
• mrpowers-io / quinn
  pyspark methods to enhance developer productivity 📣 👯 🎉
  ☆643Updated last month
• sodadata / soda-core
  Data quality testing for the modern data stack (SQL, Spark, and Pandas) https://www.soda.io
  ☆1,913Updated this week
• dbt-labs / dbt-spark
  dbt-spark contains all of the code enabling dbt to work with Apache Spark and Databricks
  ☆405Updated last week
• MrPowers / mack
  Delta Lake helper methods in PySpark
  ☆304Updated 2 months ago
• calogica / dbt-expectations
  Port(ish) of Great Expectations to dbt test macros
  ☆1,083Updated 2 months ago
• paypal / data-contract-template
  Template for a data contract used in a data mesh.
  ☆464Updated 8 months ago
• gocardless / airflow-dbt
  Apache Airflow integration for dbt
  ☆396Updated 6 months ago
• astronomer / astro-sdk
  Astro SDK allows rapid and clean development of {Extract, Load, Transform} workflows using Python and SQL, powered by Apache Airflow.
  ☆350Updated this week
• dbt-labs / dbt-athena
  The athena adapter plugin for dbt (https://getdbt.com)
  ☆227Updated this week
• astronomer / airflow-provider-great-expectations
  Great Expectations Airflow operator
  ☆159Updated 3 weeks ago
• palantir / pyspark-style-guide
  This is a guide to PySpark code style presenting common situations and the associated best practices based on the most frequent recurring…
  ☆1,063Updated 2 months ago
• awslabs / deequ
  Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.
  ☆3,309Updated last month
• astronomer / dag-factory
  Dynamically generate Apache Airflow DAGs from YAML configuration files
  ☆1,209Updated this week
• greatexpectationslabs / ge_tutorials
  Learn how to add data validation and documentation to a data pipeline built with dbt and Airflow.
  ☆166Updated last year
• bitol-io / open-data-contract-standard
  Home of the Open Data Contract Standard (ODCS).
  ☆392Updated last week
• Nike-Inc / spark-expectations
  A Python Library to support running data quality rules while the spark job is running⚡
  ☆163Updated last week
• apache / iceberg-python
  Apache PyIceberg
  ☆473Updated this week
• spbail / dag-stack
  Data pipeline with dbt, Airflow, Great Expectations
  ☆158Updated 3 years ago
• eakmanrq / sqlframe
  Turning PySpark Into a Universal DataFrame API
  ☆323Updated this week
• re-data / re-data
  re_data - fix data issues before your users & CEO would discover them 😊
  ☆1,552Updated 6 months ago
• Tomme / dbt-athena
  The athena adapter plugin for dbt (https://getdbt.com)
  ☆141Updated last year
• GoogleCloudDataproc / spark-bigquery-connector
  BigQuery data source for Apache Spark: Read data from BigQuery into DataFrames, write DataFrames into BigQuery tables.
  ☆377Updated this week
• adidas / lakehouse-engine
  The Lakehouse Engine is a configuration driven Spark framework, written in Python, serving as a scalable and distributed engine for sever…
  ☆223Updated 3 weeks ago
• delta-io / delta-sharing
  An open protocol for secure data sharing
  ☆770Updated last week
• astronomer / astronomer-cosmos
  Run your dbt Core projects as Apache Airflow DAGs and Task Groups with a few lines of code
  ☆760Updated this week