spbail / data-quality-tools
Content for a talk on "The wonderful world of data quality tools in Python"
☆18Updated 4 years ago
Alternatives and similar repositories for data-quality-tools
Users that are interested in data-quality-tools are comparing it to the libraries listed below
Sorting:
- Code to help generate SQL for stakeholders. Code at https://www.startdataengineering.com/post/data-democratize-llm/☆11Updated 11 months ago
- Fake Pandas / PySpark DataFrame creator☆46Updated last year
- Sample project that use Dagster, dbt, DuckDB and Dash to visualize car and motorcycle Spanish market☆58Updated 2 years ago
- A modern ELT demo using airbyte, dbt, snowflake and dagster☆27Updated 2 years ago
- A simple and easy to use Data Quality (DQ) tool built with Python.☆50Updated last year
- JumpSpark - A modern cookiecutter template for pyspark projects with batteries included.☆10Updated 2 years ago
- Tutorials for Fugue - A unified interface for distributed computing. Fugue executes SQL, Python, and Pandas code on Spark and Dask withou…☆113Updated last year
- Full stack data engineering tools and infrastructure set-up☆53Updated 4 years ago
- Code for my "Efficient Data Processing in SQL" book.☆56Updated 9 months ago
- A Python package to help Databricks Unity Catalog users to read and query Delta Lake tables with Polars, DuckDb, or PyArrow.☆23Updated last year
- Dask integration for Snowflake☆30Updated 6 months ago
- A PyTest plugin to speed up your tests which depend on Snowflake sessions☆27Updated last year
- ☆18Updated 9 months ago
- Cost Efficient Data Pipelines with DuckDB☆52Updated this week
- Evaluation Matrix for Change Data Capture☆25Updated 9 months ago
- csv and flat-file sniffer built in Rust.☆42Updated last year
- Arcane Insight is a data analytics project designed to harness the power of SQLMesh & DuckDB to collect, transform, and analyze data from…☆34Updated 3 months ago
- Fully unit tested utility functions for data engineering. Python 3 only.☆16Updated 8 months ago
- ☆16Updated last year
- Build your feature store with macros right within your dbt repository☆38Updated 2 years ago
- Code for data quality with greatexpectations blog☆12Updated 9 months ago
- Ibis analytics, with Ibis (and more!)☆21Updated 7 months ago
- Data-aware orchestration with dagster, dbt, and airbyte☆31Updated 2 years ago
- A portable Datamart and Business Intelligence suite built with Docker, sqlmesh + dbtcore, DuckDB and Superset☆50Updated 6 months ago
- Building 3D Trusted Data Pipelines With Dagster, Dbt, and Duckdb☆20Updated last year
- Demo repository to lambda-fy your dbt runs☆11Updated last year
- New generation opensource data stack☆68Updated 2 years ago
- Supporting materials/code examples for my course in data engineering for machine learning.☆38Updated 2 years ago
- Read Delta tables without any Spark☆47Updated last year
- Write your dbt models using Ibis☆65Updated 2 months ago