Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.
☆3,612Apr 26, 2026Updated last week
Alternatives and similar repositories for deequ
Users that are interested in deequ are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Python API for Deequ☆817Updated this week
- Always know what to expect from your data.☆11,458Updated this week
- Amundsen is a metadata driven application for improving the productivity of data analysts, data scientists and engineers when interacting…☆4,761Apr 2, 2026Updated last month
- An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Tr…☆8,767Updated this week
- Data Contracts engine for the modern data stack. https://www.soda.io☆2,342Updated this week
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Essential Spark extensions and helper methods ✨😲☆766Sep 14, 2025Updated 7 months ago
- Mirror of Apache griffin☆1,170Aug 3, 2025Updated 9 months ago
- A simplified, lightweight ETL Framework based on Apache Spark☆588Jan 24, 2024Updated 2 years ago
- An Open Standard for lineage metadata collection☆2,430Updated this week
- The Context Platform for your Data and AI Stack☆11,854Updated this week
- Collect, aggregate, and visualize a data ecosystem's metadata☆2,172Apr 22, 2026Updated last week
- pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoD…☆4,107Updated this week
- Base classes to use when writing tests with Spark☆1,553Apr 20, 2026Updated last week
- Data Lineage Tracking And Visualization Solution☆657Apr 23, 2026Updated last week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Upserts, Deletes And Incremental Processing on Big Data.☆6,150Updated this week
- Apache Iceberg☆8,792Updated this week
- Qubole Sparklens tool for performance tuning Apache Spark☆588Jun 26, 2024Updated last year
- Apache Spark testing helpers (dependency free & works with Scalatest, uTest, and MUnit)☆455Apr 2, 2026Updated last month
- pyspark methods to enhance developer productivity 📣 👯 🎉☆687Mar 6, 2025Updated last year
- The Open Source Feature Store for AI/ML☆6,985Updated this week
- dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build application…☆12,717Updated this week
- Automated data quality suggestions and analysis with Deequ on AWS Glue☆91Dec 29, 2022Updated 3 years ago
- Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)☆12,764Updated this week
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- Nessie: Transactional Catalog for Data Lakes with Git-like semantics☆1,453Updated this week
- ☆1,683Apr 15, 2026Updated 2 weeks ago
- Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.☆2,325Apr 24, 2026Updated last week
- Expressive types for Spark.☆896Updated this week
- An orchestration platform for the development, production, and observation of data assets.☆15,390Apr 24, 2026Updated last week
- MLeap: Deploy ML Pipelines to Production☆1,535Mar 10, 2026Updated last month
- Kubernetes operator for managing the lifecycle of Apache Spark applications on Kubernetes.☆3,121Updated this week
- Jupyter magics and kernels for working with remote Spark clusters☆1,360Sep 9, 2025Updated 7 months ago
- A better notebook for Scala (and more)☆4,591Jan 27, 2026Updated 3 months ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- This repository contains the development code for sparkMeasure, an Apache Spark performance analysis and troubleshooting library. It simp…☆821Apr 24, 2026Updated last week
- A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rew…☆2,155Updated this week
- re_data - fix data issues before your users & CEO would discover them 😊☆1,569Apr 30, 2024Updated 2 years ago
- Open, Multi-modal Catalog for Data & AI☆3,375Updated this week
- Build, Manage and Deploy AI/ML Systems☆10,063Updated this week
- An open protocol for secure data sharing☆937Apr 25, 2026Updated last week
- Apache Airflow - A platform to programmatically author, schedule, and monitor workflows☆45,231Updated this week