capitalone / datacompyLinks
Pandas, Polars, Spark, and Snowpark DataFrame comparison for humans and more!
☆623Updated last week
Alternatives and similar repositories for datacompy
Users that are interested in datacompy are comparing it to the libraries listed below
Sorting:
- Python API for Deequ☆808Updated 9 months ago
- Possibly the fastest DataFrame-agnostic quality check library in town.☆233Updated 2 months ago
- PySpark test helper methods with beautiful error messages☆743Updated 2 weeks ago
- pyspark methods to enhance developer productivity 📣 👯 🎉☆682Updated 9 months ago
- Turning PySpark Into a Universal DataFrame API☆469Updated 2 weeks ago
- Learn how to add data validation and documentation to a data pipeline built with dbt and Airflow.☆168Updated 2 years ago
- Pythonic Programming Framework to orchestrate jobs in Databricks Workflow☆222Updated last month
- Great Expectations Airflow operator☆169Updated 3 weeks ago
- Monitor the stability of a Pandas or Spark dataframe ⚙︎☆509Updated 4 months ago
- Turbodbc is a Python module to access relational databases via the Open Database Connectivity (ODBC) interface. The module complies with …☆649Updated this week
- Snowflake Snowpark Python API☆320Updated this week
- Snowflake SQLAlchemy☆261Updated last week
- Distributed SQL Engine in Python using Dask☆409Updated last year
- Data quality testing for the modern data stack (SQL, Spark, and Pandas) https://www.soda.io☆2,271Updated this week
- Generate and Visualize Data Lineage from query history☆327Updated 2 years ago
- Read/Write pandas DataFrames with Tableau Hyper Extracts☆121Updated 2 months ago
- Snowflake Connector for Python☆701Updated this week
- Delta Lake helper methods in PySpark☆325Updated last year
- ☆81Updated 10 months ago
- Making DAG construction easier☆283Updated 2 weeks ago
- ✨ A Pydantic to PySpark schema library☆115Updated last week
- Tutorials for Fugue - A unified interface for distributed computing. Fugue executes SQL, Python, and Pandas code on Spark and Dask withou…☆114Updated last month
- Dagster Labs' open-source data platform, built with Dagster.☆425Updated last week
- A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rew…☆2,132Updated this week
- A CLI tool to streamline getting started with Apache Airflow™ and managing multiple Airflow projects☆225Updated 8 months ago
- Create HTML profiling reports from Apache Spark DataFrames☆197Updated 5 years ago
- Tool to automate data quality checks on data pipelines☆257Updated 3 years ago
- Better SQL in Jupyter. 📊☆835Updated 3 months ago
- Astro SDK allows rapid and clean development of {Extract, Load, Transform} workflows using Python and SQL, powered by Apache Airflow.☆377Updated 7 months ago
- Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark☆1,539Updated last year