Spark package for checking data quality
☆221Feb 28, 2020Updated 6 years ago
Alternatives and similar repositories for drunken-data-quality
Users that are interested in drunken-data-quality are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Data-Driven Spark allows quick data exploration based on Apache Spark.☆29Jan 6, 2017Updated 9 years ago
- DataQuality for BigData☆149Dec 15, 2023Updated 2 years ago
- type-class based data cleansing library for Apache Spark SQL☆79Jun 23, 2019Updated 6 years ago
- Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.☆3,620Jun 8, 2026Updated last week
- Simple Spark example of generating table stats for use of data quality checks☆27Apr 28, 2017Updated 9 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Spark Mllib 1.6.0版本算法封装☆11Mar 8, 2017Updated 9 years ago
- Base classes to use when writing tests with Spark☆1,553Apr 20, 2026Updated last month
- A framework for creating composable and pluggable data processing pipelines using Apache Spark, and running them on a cluster.☆47Aug 1, 2016Updated 9 years ago
- Essential Spark extensions and helper methods ✨😲☆767Sep 14, 2025Updated 9 months ago
- Data Lineage Tracking And Visualization Solution☆660Jun 2, 2026Updated last week
- python automatic data quality check toolkit☆277Sep 15, 2020Updated 5 years ago
- Lighthouse is a library for data lakes built on top of Apache Spark. It provides high-level APIs in Scala to streamline data pipelines an…☆63Sep 6, 2024Updated last year
- ☆28Jan 9, 2026Updated 5 months ago
- SmartFD: Efficient and Scalable Functional Dependency Discovery on Distributed Data-Parallel Platforms☆18Aug 23, 2018Updated 7 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Qubole Sparklens tool for performance tuning Apache Spark☆591Jun 26, 2024Updated last year
- A collection of Apache Parquet add-on modules☆30May 20, 2026Updated 3 weeks ago
- Jumbune, an open source BigData APM & Data Quality Management Platform for Data Clouds. Enterprise feature offering is available at http:…☆73Jan 1, 2023Updated 3 years ago
- Tutorial and examples of Data Quality in Big Data System☆11Apr 25, 2017Updated 9 years ago
- Preliminary Solr DQ / Data Quality experiments and prototype, and SolrJ wrapper utilities☆26Jan 27, 2025Updated last year
- Spark package to "plug" holes in data using SQL based rules ⚡️ 🔌☆28May 15, 2020Updated 6 years ago
- Build configuration-driven ETL pipelines on Apache Spark☆162Oct 4, 2022Updated 3 years ago
- Apache Spark testing helpers (dependency free & works with Scalatest, uTest, and MUnit)☆456Apr 2, 2026Updated 2 months ago
- Big Data Toolkit for the JVM☆148Nov 4, 2020Updated 5 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Expressive types for Spark.☆898Updated this week
- Make your project more clippity implicitly with imclipitly☆17Apr 29, 2017Updated 9 years ago
- Big Data ETL and Utilities for Hadoop Map Reduce, Spark and Storm☆106Jan 22, 2024Updated 2 years ago
- Builds Airflow DAGs from configuration files. Powers all DAGs on the Etsy Data Platform☆259Jul 19, 2023Updated 2 years ago
- An example project using Spark Streaming with Kafka message and Avro serialization☆12Aug 21, 2015Updated 10 years ago
- Utilities for Apache Spark☆34Mar 5, 2016Updated 10 years ago
- Shunting Yard is a real-time data replication tool that copies data between Hive Metastores.☆20Oct 11, 2021Updated 4 years ago
- Apache Amaterasu☆56Oct 18, 2019Updated 6 years ago
- Avro record class and reader generator☆20Aug 26, 2022Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- GA Grid (Beta) is a distributive in memory Genetic Algorithm (GA) component for Apache Ignite. A GA is a method of solving complex optimi…☆11Nov 14, 2017Updated 8 years ago
- Benchmarks of artificial neural network library for Spark MLlib☆11Dec 3, 2015Updated 10 years ago
- A Spark SQL extension which provides SQL Standard Authorization for Apache Spark | This repo is contributed to Apache Kyuubi | 项目已迁移至 Apa…☆184Apr 6, 2022Updated 4 years ago
- ☆70Mar 15, 2021Updated 5 years ago
- A toy redis client implementation in Scala☆24Nov 2, 2019Updated 6 years ago
- Tool for visualizing Apache Oozie pipelines☆13Feb 15, 2016Updated 10 years ago
- PySpark for ETL jobs including lineage to Apache Atlas in one script via code inspection☆17Jan 12, 2017Updated 9 years ago