Pandas, Polars, Spark, and Snowpark DataFrame comparison for humans and more!
☆637Feb 20, 2026Updated last week
Alternatives and similar repositories for datacompy
Users that are interested in datacompy are comparing it to the libraries listed below
Sorting:
- locopy: Loading/Unloading to Redshift and Snowflake using Python.☆115Updated this week
- What's in your data? Extract schema, statistics and entities from datasets☆1,545Sep 26, 2025Updated 5 months ago
- A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rew…☆2,139Feb 21, 2026Updated last week
- Lightweight and extensible compatibility layer between dataframe libraries!☆1,542Updated this week
- Data Contracts engine for the modern data stack. https://www.soda.io☆2,298Updated this week
- the portable Python dataframe library☆6,417Updated this week
- A light-weight, flexible, and expressive statistical data testing library☆4,212Feb 19, 2026Updated last week
- Always know what to expect from your data.☆11,197Updated this week
- Scalable and efficient data transformation framework - backwards compatible with dbt.☆2,928Updated this week
- Python SQL Parser and Transpiler☆8,965Updated this week
- Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark☆1,540Dec 2, 2024Updated last year
- pyspark methods to enhance developer productivity 📣 👯 🎉☆683Mar 6, 2025Updated 11 months ago
- Delta Lake helper methods in PySpark☆327Jan 19, 2026Updated last month
- Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.☆3,588Feb 17, 2026Updated 2 weeks ago
- Read and write CSV on the Web (csvw) tables and metadata in R☆16Jan 21, 2024Updated 2 years ago
- Tools for faster and optimized interaction with Teradata and large datasets.☆17Jul 11, 2018Updated 7 years ago
- 1 Line of code data quality profiling & exploratory data analysis for Pandas and Spark DataFrames.☆13,399Updated this week
- Python API for Deequ☆814Jan 21, 2026Updated last month
- a pytest plugin for dbt adapter test suites☆19Oct 31, 2023Updated 2 years ago
- PySpark test helper methods with beautiful error messages☆753Updated this week
- Fastest library to load data from DB to DataFrames in Rust and Python☆2,567Updated this week
- DuckDB for streaming data☆748Sep 4, 2025Updated 5 months ago
- DuckDB-powered Postgres for high performance apps & analytics.☆2,967Feb 4, 2026Updated last month
- Run greatexpectations.io on ANY SQL Engine using REST API. Supported by FastAPI, Pydantic and SQLAlchemy as best data quality tool☆14Dec 12, 2025Updated 2 months ago
- data load tool (dlt) is an open source Python library that makes data loading easy 🛠️☆4,980Updated this week
- Possibly the fastest DataFrame-agnostic quality check library in town.☆240Feb 5, 2026Updated 3 weeks ago
- 🏃♀️ Minimalist SQL orchestrator☆306Feb 17, 2026Updated 2 weeks ago
- Turning PySpark Into a Universal DataFrame API☆493Updated this week
- pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoD…☆4,107Updated this week
- dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build application…☆12,315Updated this week
- Amundsen is a metadata driven application for improving the productivity of data analysts, data scientists and engineers when interacting…☆4,740Feb 19, 2026Updated last week
- Modin: Scale your Pandas workflows by changing a single line of code☆10,363Feb 10, 2026Updated 3 weeks ago
- Filling in the Spark function gaps across APIs☆50Apr 14, 2021Updated 4 years ago
- Wave Partial Differential Equation Solver in Python☆14Jun 5, 2024Updated last year
- JumpSpark - A modern cookiecutter template for pyspark projects with batteries included.☆10May 12, 2023Updated 2 years ago
- Prefect is a workflow orchestration framework for building resilient data pipelines in Python.☆21,697Updated this week
- Recipes for using Python's polars library☆275Sep 8, 2024Updated last year
- Extremely fast Query Engine for DataFrames, written in Rust☆37,582Updated this week
- Out-of-Core hybrid Apache Arrow/NumPy DataFrame for Python, ML, visualization and exploration of big tabular data at a billion rows per s…☆8,475Feb 5, 2026Updated 3 weeks ago