A dynamic data completeness and accuracy library at enterprise scale for Apache Spark
☆29Nov 4, 2024Updated last year
Alternatives and similar repositories for atum
Users that are interested in atum are comparing it to the libraries listed below
Sorting:
- Dynamic Conformance Engine☆32Oct 17, 2025Updated 4 months ago
- Scala API for Apache Spark SQL high-order functions☆14Aug 4, 2023Updated 2 years ago
- Extensible streaming ingestion pipeline on top of Apache Spark☆46Jul 17, 2025Updated 7 months ago
- Resilient data pipeline framework running on Apache Spark☆26Updated this week
- Avro SerDe for Apache Spark structured APIs.☆241Jun 10, 2025Updated 8 months ago
- A COBOL parser and Mainframe/EBCDIC data source for Apache Spark☆158Updated this week
- Library and a Framework for building fast, scalable, fault-tolerant Data APIs based on Akka, Avro, ZooKeeper and Kafka☆25Oct 16, 2020Updated 5 years ago
- Data Lineage Tracking And Visualization Solution☆656Feb 16, 2026Updated last week
- Spark package to "plug" holes in data using SQL based rules ⚡️ 🔌☆29May 15, 2020Updated 5 years ago
- Waimak is an open-source framework that makes it easier to create complex data flows in Apache Spark.☆76Apr 24, 2024Updated last year
- Qubole Streaminglens tool for tuning Spark Structured Streaming Pipelines☆17Jan 21, 2020Updated 6 years ago
- A collection of Apache Parquet add-on modules☆30Feb 12, 2026Updated 2 weeks ago
- Apache Amaterasu☆56Oct 18, 2019Updated 6 years ago
- Gives TreeLog a GUI, the ScalaJS ReactTreeView☆10Jun 23, 2016Updated 9 years ago
- Open source task scheduler with dependency management☆15Jul 1, 2018Updated 7 years ago
- Ultra-high-performance local IPC framework with Zipkin tracing to conduct a beautiful symphony of (brotherhood) build tooling.☆10Jan 8, 2021Updated 5 years ago
- Apache-Spark based Data Flow(ETL) Framework which supports multiple read, write destinations of different types and also support multiple…☆26Jun 7, 2021Updated 4 years ago
- Big Data ETL and Utilities for Hadoop Map Reduce, Spark and Storm☆104Jan 22, 2024Updated 2 years ago
- A library that brings useful functions from various modern database management systems to Apache Spark☆61Sep 4, 2023Updated 2 years ago
- Nested array transformation helper extensions for Apache Spark☆37Aug 4, 2023Updated 2 years ago
- Text Analytics Pipeline (TAP)☆17Jan 4, 2026Updated last month
- low-level helpers for Apache Spark libraries and tests☆16Dec 29, 2018Updated 7 years ago
- A tool to validate data, built around Apache Spark.☆100Feb 19, 2026Updated last week
- something to help you spark☆64Oct 23, 2018Updated 7 years ago
- Common utilities for Apache Kafka☆36Aug 7, 2023Updated 2 years ago
- Documentation, examples and utilities for Flatlline, BigML's dataset transformation and generation language☆26Mar 18, 2025Updated 11 months ago
- A pyspark lib to validate data quality☆18Nov 11, 2022Updated 3 years ago
- Smart Automation Tool for building modern Data Lakes and Data Pipelines☆122Updated this week
- ☆45Apr 27, 2020Updated 5 years ago
- Maelstrom is an open source Kafka integration with Spark that is designed to be developer friendly, high performance (millisecond stream …☆22Feb 6, 2017Updated 9 years ago
- an open source dataworks platform☆21Jun 4, 2021Updated 4 years ago
- Sample processing code using Spark 2.1+ and Scala☆51Jun 28, 2020Updated 5 years ago
- Opinionated configuration files powered by Ansible.☆35Dec 31, 2018Updated 7 years ago
- A framework for systematically quality controlling big data.☆40Mar 13, 2023Updated 2 years ago
- Code and examples of how to write and deploy Apache Spark Plugins. Spark plugins allow runnig custom code on the executors as they are in…☆94May 9, 2025Updated 9 months ago
- Apache DataLab (incubating)☆152Oct 3, 2023Updated 2 years ago
- 🚚 ETL for Spark and Airflow☆25Mar 19, 2018Updated 7 years ago
- Gradle plugin for Scalafix☆28Nov 26, 2025Updated 3 months ago
- Multi-stage, config driven, SQL based ETL framework using PySpark☆26Sep 16, 2019Updated 6 years ago