Spark package for checking data quality
☆220Feb 28, 2020Updated 6 years ago
Alternatives and similar repositories for drunken-data-quality
Users that are interested in drunken-data-quality are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Data-Driven Spark allows quick data exploration based on Apache Spark.☆29Jan 6, 2017Updated 9 years ago
- DataQuality for BigData☆149Dec 15, 2023Updated 2 years ago
- Data Quality Monitoring Tool☆15Dec 5, 2017Updated 8 years ago
- type-class based data cleansing library for Apache Spark SQL☆78Jun 23, 2019Updated 7 years ago
- Extensible Rules Engine for custom Dataframe / Dataset validation☆141May 7, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Spark package for checking data quality☆26Mar 30, 2023Updated 3 years ago
- Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.☆3,649Updated this week
- Simple Spark example of generating table stats for use of data quality checks☆27Apr 28, 2017Updated 9 years ago
- Spark Mllib 1.6.0版本算法封装☆11Mar 8, 2017Updated 9 years ago
- Base classes to use when writing tests with Spark☆1,554Sep 28, 2026Updated 2 weeks ago
- A framework for creating composable and pluggable data processing pipelines using Apache Spark, and running them on a cluster.☆47Aug 1, 2016Updated 10 years ago
- Essential Spark extensions and helper methods ✨😲☆766Oct 1, 2026Updated 2 weeks ago
- Data Lineage Tracking And Visualization Solution☆668Oct 8, 2026Updated last week
- SmartFD: Efficient and Scalable Functional Dependency Discovery on Distributed Data-Parallel Platforms☆19Aug 23, 2018Updated 8 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Lighthouse is a library for data lakes built on top of Apache Spark. It provides high-level APIs in Scala to streamline data pipelines an…☆64Sep 6, 2024Updated 2 years ago
- Qubole Sparklens tool for performance tuning Apache Spark☆593Jun 26, 2024Updated 2 years ago
- ☆28Jan 9, 2026Updated 9 months ago
- A package full of linear algebra operators for Apache Spark MLlib's linalg package☆10Sep 9, 2015Updated 11 years ago
- Tutorial and examples of Data Quality in Big Data System☆11Apr 25, 2017Updated 9 years ago
- Full-stack OpenTelemetry observability for Apache Spark☆20Updated this week
- A Scalable Data Cleaning Library for PySpark.☆29Apr 4, 2019Updated 7 years ago
- Preliminary Solr DQ / Data Quality experiments and prototype, and SolrJ wrapper utilities☆26Jan 27, 2025Updated last year
- Build configuration-driven ETL pipelines on Apache Spark☆162Oct 4, 2022Updated 4 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- An example of using Avro and Parquet in Spark SQL☆60Nov 16, 2015Updated 10 years ago
- Big Data ETL and Utilities for Hadoop Map Reduce, Spark and Storm☆106Jan 22, 2024Updated 2 years ago
- Apache Spark testing helpers (dependency free & works with Scalatest, uTest, and MUnit)☆456Apr 2, 2026Updated 6 months ago
- Make your project more clippity implicitly with imclipitly☆17Apr 29, 2017Updated 9 years ago
- Expressive types for Spark.☆896Oct 8, 2026Updated last week
- Utilities for Apache Spark☆35Mar 5, 2016Updated 10 years ago
- A collection of Apache Parquet add-on modules☆31Oct 2, 2026Updated 2 weeks ago
- Builds Airflow DAGs from configuration files. Powers all DAGs on the Etsy Data Platform☆260Jul 19, 2023Updated 3 years ago
- ☆70Mar 15, 2021Updated 5 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Shunting Yard is a real-time data replication tool that copies data between Hive Metastores.☆20Oct 11, 2021Updated 5 years ago
- sql解析和执行，能够执行hive, spark, flink, 以及对应对TensorFlow, Deeplearning4j的算法SQL执行☆11Sep 16, 2022Updated 4 years ago
- Apache Amaterasu☆56Oct 18, 2019Updated 6 years ago
- Big Data Toolkit for the JVM☆147Nov 4, 2020Updated 5 years ago
- A Spark SQL extension which provides SQL Standard Authorization for Apache Spark | This repo is contributed to Apache Kyuubi | 项目已迁移至 Apa…☆182Apr 6, 2022Updated 4 years ago
- Tool for visualizing Apache Oozie pipelines☆13Feb 15, 2016Updated 10 years ago
- Avro record class and reader generator☆20Aug 26, 2022Updated 4 years ago