Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.
☆3,603Apr 1, 2026Updated last week
Alternatives and similar repositories for deequ
Users that are interested in deequ are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Python API for Deequ☆815Mar 9, 2026Updated last month
- Always know what to expect from your data.☆11,391Updated this week
- Amundsen is a metadata driven application for improving the productivity of data analysts, data scientists and engineers when interacting…☆4,756Apr 2, 2026Updated last week
- An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Tr…☆8,746Updated this week
- Data Contracts engine for the modern data stack. https://www.soda.io☆2,326Updated this week
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- Essential Spark extensions and helper methods ✨😲☆766Sep 14, 2025Updated 6 months ago
- Mirror of Apache griffin☆1,172Aug 3, 2025Updated 8 months ago
- A simplified, lightweight ETL Framework based on Apache Spark☆587Jan 24, 2024Updated 2 years ago
- An Open Standard for lineage metadata collection☆2,396Updated this week
- The Metadata Platform for your Data and AI Stack☆11,775Updated this week
- Collect, aggregate, and visualize a data ecosystem's metadata☆2,156Updated this week
- pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoD…☆4,106Updated this week
- Base classes to use when writing tests with Spark☆1,551Updated this week
- Data Lineage Tracking And Visualization Solution☆657Apr 3, 2026Updated last week
- DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Upserts, Deletes And Incremental Processing on Big Data.☆6,139Updated this week
- Apache Iceberg☆8,700Updated this week
- Qubole Sparklens tool for performance tuning Apache Spark☆589Jun 26, 2024Updated last year
- Apache Spark testing helpers (dependency free & works with Scalatest, uTest, and MUnit)☆455Apr 2, 2026Updated last week
- pyspark methods to enhance developer productivity 📣 👯 🎉☆687Mar 6, 2025Updated last year
- The Open Source Feature Store for AI/ML☆6,908Updated this week
- dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build application…☆12,605Updated this week
- Automated data quality suggestions and analysis with Deequ on AWS Glue☆91Dec 29, 2022Updated 3 years ago
- Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)☆12,700Updated this week
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Nessie: Transactional Catalog for Data Lakes with Git-like semantics☆1,450Updated this week
- ☆1,685Updated this week
- Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.☆2,318Apr 4, 2026Updated last week
- Expressive types for Spark.☆896Updated this week
- An orchestration platform for the development, production, and observation of data assets.☆15,216Apr 3, 2026Updated last week
- MLeap: Deploy ML Pipelines to Production☆1,536Mar 10, 2026Updated last month
- Kubernetes operator for managing the lifecycle of Apache Spark applications on Kubernetes.☆3,111Updated this week
- Jupyter magics and kernels for working with remote Spark clusters☆1,361Sep 9, 2025Updated 7 months ago
- A better notebook for Scala (and more)☆4,594Jan 27, 2026Updated 2 months ago
- Wordpress hosting with auto-scaling on Cloudways • AdFully Managed hosting built for WordPress-powered businesses that need reliable, auto-scalable hosting. Cloudways SafeUpdates now available.
- This repository contains the development code for sparkMeasure, an Apache Spark performance analysis and troubleshooting library. It simp…☆820Apr 1, 2026Updated last week
- re_data - fix data issues before your users & CEO would discover them 😊☆1,570Apr 30, 2024Updated last year
- A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rew…☆2,149Apr 1, 2026Updated last week
- Build, Manage and Deploy AI/ML Systems☆10,016Updated this week
- Open, Multi-modal Catalog for Data & AI☆3,354Updated this week
- An open protocol for secure data sharing☆932Apr 3, 2026Updated last week
- Apache Airflow - A platform to programmatically author, schedule, and monitor workflows☆44,964Updated this week