Pandas, Polars, Spark, and Snowpark DataFrame comparison for humans and more!
☆639Mar 13, 2026Updated last week
Alternatives and similar repositories for datacompy
Users that are interested in datacompy are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- locopy: Loading/Unloading to Redshift and Snowflake using Python.☆115Updated this week
- What's in your data? Extract schema, statistics and entities from datasets☆1,552Sep 26, 2025Updated 5 months ago
- A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rew…☆2,142Mar 12, 2026Updated last week
- Data Contracts engine for the modern data stack. https://www.soda.io☆2,309Mar 17, 2026Updated last week
- Capture all information throughout your model's development in a reproducible way and tie results directly to the model code!☆139Updated this week
- Always know what to expect from your data.☆11,280Updated this week
- Lightweight and extensible compatibility layer between dataframe libraries!☆1,562Updated this week
- the portable Python dataframe library☆6,457Updated this week
- A light-weight, flexible, and expressive statistical data testing library☆4,259Updated this week
- Python SQL Parser and Transpiler☆9,064Updated this week
- Scalable and efficient data transformation framework - backwards compatible with dbt.☆2,975Updated this week
- pyspark methods to enhance developer productivity 📣 👯 🎉☆685Mar 6, 2025Updated last year
- Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark☆1,539Dec 2, 2024Updated last year
- A three-hour tutorial on property-based testing with https://hypothesis.works☆59Mar 3, 2024Updated 2 years ago
- Tools for faster and optimized interaction with Teradata and large datasets.☆17Jul 11, 2018Updated 7 years ago
- pytest plugin to run the tests with support of pyspark☆88May 21, 2025Updated 10 months ago
- Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.☆3,596Updated this week
- 1 Line of code data quality profiling & exploratory data analysis for Pandas and Spark DataFrames.☆13,438Mar 3, 2026Updated 3 weeks ago
- PySpark test helper methods with beautiful error messages☆755Feb 25, 2026Updated 3 weeks ago
- Python API for Deequ☆812Mar 9, 2026Updated 2 weeks ago
- Generating complex, nonlinear datasets appropriate for use with deep learning/black box models which 'need' nonlinearity☆47Nov 24, 2025Updated 4 months ago
- DuckDB for streaming data☆749Sep 4, 2025Updated 6 months ago
- Fastest library to load data from DB to DataFrames in Rust and Python☆2,573Mar 11, 2026Updated last week
- Run greatexpectations.io on ANY SQL Engine using REST API. Supported by FastAPI, Pydantic and SQLAlchemy as best data quality tool☆14Dec 12, 2025Updated 3 months ago
- A collection of python utility functions☆11Mar 12, 2026Updated last week
- Sharable Grakn knowledge graphs☆14Dec 28, 2022Updated 3 years ago
- Delta Lake helper methods in PySpark☆328Jan 19, 2026Updated 2 months ago
- An abstraction layer for parameter tuning☆35Dec 16, 2025Updated 3 months ago
- Easily make interactive plots of player-tracking data☆11Sep 20, 2021Updated 4 years ago
- Extremely fast Query Engine for DataFrames, written in Rust☆37,810Updated this week
- Possibly the fastest DataFrame-agnostic quality check library in town.☆241Feb 5, 2026Updated last month
- a pytest plugin for dbt adapter test suites☆19Oct 31, 2023Updated 2 years ago
- pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoD…☆4,106Updated this week
- Recipes for using Python's polars library☆275Sep 8, 2024Updated last year
- A Spark-based data comparison tool at scale which facilitates software development engineers to compare a plethora of pair combinations o…☆52Jun 17, 2025Updated 9 months ago
- Sample code for building a Python application for Apache Flink on Kinesis Data Analytics.☆14Aug 30, 2023Updated 2 years ago
- Prefect is a workflow orchestration framework for building resilient data pipelines in Python.☆21,910Updated this week
- ☆12Jul 23, 2025Updated 8 months ago
- DuckDB-powered Postgres for high performance apps & analytics.☆3,003Mar 16, 2026Updated last week