Nike-Inc / spark-expectations
A Python Library to support running data quality rules while the spark job is running⚡
☆163Updated last week
Related projects ⓘ
Alternatives and complementary repositories for spark-expectations
- Pythonic Programming Framework to orchestrate jobs in Databricks Workflow☆189Updated last week
- Delta Lake helper methods in PySpark☆304Updated 2 months ago
- Delta Lake examples☆207Updated last month
- Delta lake and filesystem helper methods☆49Updated 8 months ago
- PyJaws: A Pythonic Way to Define Databricks Jobs and Workflows☆41Updated 4 months ago
- The Lakehouse Engine is a configuration driven Spark framework, written in Python, serving as a scalable and distributed engine for sever…☆223Updated 3 weeks ago
- Delta Lake helper methods. No Spark dependency.☆22Updated 2 months ago
- Spark style guide☆256Updated last month
- Soda Spark is a PySpark library that helps you with testing your data in Spark Dataframes☆63Updated 2 years ago
- A library that provides useful extensions to Apache Spark and PySpark.☆196Updated 2 weeks ago
- Custom PySpark Data Sources☆27Updated 2 months ago
- Delta Lake Documentation☆46Updated 5 months ago
- This repo is a collection of tools to deploy, manage and operate a Databricks based Lakehouse.☆41Updated 3 weeks ago
- Performance Observability for Apache Spark☆197Updated this week
- Code samples, etc. for Databricks☆60Updated last month
- DBSQL SME Repo contains demos, tutorials, blog code, advanced production helper functions and more!☆37Updated this week