benchsci / tinsel
PySpark schema generator
☆41Updated last year
Alternatives and similar repositories for tinsel:
Users that are interested in tinsel are comparing it to the libraries listed below
- ✨ A Pydantic to PySpark schema library☆69Updated this week
- Pythonic Programming Framework to orchestrate jobs in Databricks Workflow☆199Updated last week
- Delta lake and filesystem helper methods☆50Updated 11 months ago
- Delta reader for the Ray open-source toolkit for building ML applications☆45Updated last year
- JumpSpark - A modern cookiecutter template for pyspark projects with batteries included.☆10Updated last year
- A Python Library to support running data quality rules while the spark job is running⚡☆172Updated this week
- Soda SQL and Soda Spark have been deprecated and replaced by Soda Core. docs.soda.io/soda-core/overview.html☆61Updated 2 years ago
- ☆26Updated 11 months ago
- PyJaws: A Pythonic Way to Define Databricks Jobs and Workflows☆41Updated 7 months ago
- Dask integration for Snowflake☆30Updated 3 months ago
- A Table format agnostic data sharing framework☆38Updated last year
- Soda Spark is a PySpark library that helps you with testing your data in Spark Dataframes☆63Updated 2 years ago
- Fake Pandas / PySpark DataFrame creator☆45Updated 11 months ago
- A flake8 plugin that detects of usage withColumn in a loop or inside reduce☆26Updated last month
- Data-aware orchestration with dagster, dbt, and airbyte☆31Updated 2 years ago
- Delta Lake helper methods. No Spark dependency.☆22Updated 5 months ago
- Fast iterative local development and testing of Apache Airflow workflows☆196Updated 2 months ago
- Data validation library for PySpark 3.0.0☆34Updated 2 years ago
- Pylint plugin for static code analysis on Airflow code☆93Updated 4 years ago
- pytest plugin to run the tests with support of pyspark☆84Updated 11 months ago
- Utility functions for dbt projects running on Spark☆31Updated last week
- A DataOps framework for building a lakehouse.☆42Updated this week
- Pythonic Iceberg REST Catalog☆72Updated 5 months ago
- Possibly the fastest DataFrame-agnostic quality check library in town.☆181Updated last week
- Unity Catalog UI☆39Updated 5 months ago
- [ARCHIVED] The Presto adapter plugin for dbt Core☆33Updated last year
- ☆49Updated 7 months ago
- Shed light on your data layout in order to monitor the health of your Lakehouse tables and identify when data maintenance operations shou…☆10Updated last year
- Column-wise type annotations for pyspark DataFrames☆71Updated this week
- Pytest plugin for dbt core☆58Updated last month