sodadata / soda-spark

Related projects ⓘ

Alternatives and complementary repositories for soda-spark

• Nike-Inc / spark-expectations
  A Python Library to support running data quality rules while the spark job is running⚡
  ☆163Updated last week
• Nike-Inc / brickflow
  Pythonic Programming Framework to orchestrate jobs in Databricks Workflow
  ☆189Updated last week
• MrPowers / mack
  Delta Lake helper methods in PySpark
  ☆304Updated 2 months ago
• aws-samples / dbt-glue
  This repository contains the dbt-glue adapter
  ☆101Updated this week
• astronomer / airflow-dbt-demo
  A repository of sample code to accompany our blog post on Airflow and dbt.
  ☆167Updated last year
• mrpowers-io / levi
  Delta Lake helper methods. No Spark dependency.
  ☆22Updated 2 months ago
• mrpowers-io / jodie
  Delta lake and filesystem helper methods
  ☆49Updated 8 months ago
• ananthdurai / schemata
  Schema modelling framework for decentralised domain-driven ownership of data.
  ☆247Updated 11 months ago
• astronomer / airflow-provider-great-expectations
  Great Expectations Airflow operator
  ☆159Updated 3 weeks ago
• sodadata / soda-sql
  Soda SQL and Soda Spark have been deprecated and replaced by Soda Core. docs.soda.io/soda-core/overview.html
  ☆60Updated last year
• castor-team / airflow-castor
  ☆45Updated 3 years ago
• rafaelpierre / pyjaws
  PyJaws: A Pythonic Way to Define Databricks Jobs and Workflows
  ☆41Updated 4 months ago
• getindata / dbt-airflow-factory
  Library to convert DBT manifest metadata to Airflow tasks
  ☆46Updated 8 months ago
• gmyrianthous / dbt-airflow
  A Python package that creates fine-grained dbt tasks on Apache Airflow
  ☆62Updated last month
• astronomer / astronomer-providers
  Airflow Providers containing Deferrable Operators & Sensors from Astronomer
  ☆137Updated this week
• adidas / lakehouse-engine
  The Lakehouse Engine is a configuration driven Spark framework, written in Python, serving as a scalable and distributed engine for sever…
  ☆223Updated 3 weeks ago
• feluelle / airflint
  Enforce Best Practices for all your Airflow DAGs. ⭐
  ☆92Updated this week
• delta-io / delta-examples
  Delta Lake examples
  ☆207Updated last month
• Tomme / dbt-athena
  The athena adapter plugin for dbt (https://getdbt.com)
  ☆141Updated last year
• G-Research / spark-extension
  A library that provides useful extensions to Apache Spark and PySpark.
  ☆196Updated 2 weeks ago
• dbt-labs / dbt-presto
  [ARCHIVED] The Presto adapter plugin for dbt Core
  ☆33Updated 11 months ago
• delta-io / delta-docs
  Delta Lake Documentation
  ☆46Updated 5 months ago
• malexer / pytest-spark
  pytest plugin to run the tests with support of pyspark
  ☆85Updated 8 months ago
• astronomer / airflow-data-quality-demo
  A repository of sample code to show data quality checking best practices using Airflow.
  ☆72Updated last year