mrpowers-io / jodie
Delta lake and filesystem helper methods
☆50Updated 11 months ago
Alternatives and similar repositories for jodie:
Users that are interested in jodie are comparing it to the libraries listed below
- A Python Library to support running data quality rules while the spark job is running⚡☆171Updated 3 weeks ago
- Delta Lake helper methods. No Spark dependency.☆22Updated 5 months ago
- PyJaws: A Pythonic Way to Define Databricks Jobs and Workflows☆41Updated 7 months ago
- Pythonic Programming Framework to orchestrate jobs in Databricks Workflow☆199Updated this week
- JumpSpark - A modern cookiecutter template for pyspark projects with batteries included.☆10Updated last year
- Yet Another (Spark) ETL Framework☆18Updated last year
- A library that brings useful functions from various modern database management systems to Apache Spark☆58Updated last year
- Custom PySpark Data Sources☆38Updated 3 weeks ago
- Delta Lake examples☆215Updated 4 months ago
- A platform and cloud-based service for data sharing based on the Delta Sharing protocol.☆21Updated 8 months ago
- A library that provides useful extensions to Apache Spark and PySpark.☆214Updated 2 months ago
- Spark style guide☆257Updated 4 months ago
- Delta Lake helper methods in PySpark☆315Updated 5 months ago
- Delta Lake Documentation☆48Updated 7 months ago
- Soda Spark is a PySpark library that helps you with testing your data in Spark Dataframes☆63Updated 2 years ago
- Flowchart for debugging Spark applications☆104Updated 4 months ago
- Spark and Delta Lake Workshop☆22Updated 2 years ago
- Library to convert DBT manifest metadata to Airflow tasks☆48Updated 11 months ago
- The official repository for the Rock the JVM Spark Optimization with Scala course☆57Updated last year
- A Table format agnostic data sharing framework☆38Updated last year
- ✨ A Pydantic to PySpark schema library☆69Updated this week
- Code snippets used in demos recorded for the blog.☆29Updated last week
- VSCode extension to work with Databricks☆126Updated this week
- Spark-Radiant is Apache Spark Performance and Cost Optimizer☆25Updated last month
- Delta Acceptance Testing☆20Updated 6 months ago
- A tool to validate data, built around Apache Spark.☆101Updated 2 weeks ago
- This repo is a collection of tools to deploy, manage and operate a Databricks based Lakehouse.☆44Updated 2 weeks ago
- The Lakehouse Engine is a configuration driven Spark framework, written in Python, serving as a scalable and distributed engine for sever…☆234Updated last week
- Code snippets for Data Engineering Design Patterns book☆68Updated last week
- A simple Spark-powered ETL framework that just works 🍺☆178Updated last week