A dynamic data completeness and accuracy library at enterprise scale for Apache Spark
☆29Nov 4, 2024Updated last year
Alternatives and similar repositories for atum
Users that are interested in atum are comparing it to the libraries listed below
Sorting:
- Dynamic Conformance Engine☆32Oct 17, 2025Updated 5 months ago
- Scala API for Apache Spark SQL high-order functions☆14Aug 4, 2023Updated 2 years ago
- Extensible streaming ingestion pipeline on top of Apache Spark☆46Jul 17, 2025Updated 8 months ago
- Avro SerDe for Apache Spark structured APIs.☆241Jun 10, 2025Updated 9 months ago
- Resilient data pipeline framework running on Apache Spark☆26Updated this week
- A COBOL parser and Mainframe/EBCDIC data source for Apache Spark☆159Mar 13, 2026Updated last week
- Data Lineage Tracking And Visualization Solution☆656Mar 3, 2026Updated 2 weeks ago
- Library and a Framework for building fast, scalable, fault-tolerant Data APIs based on Akka, Avro, ZooKeeper and Kafka☆25Oct 16, 2020Updated 5 years ago
- Bulletproof Apache Spark jobs with fast root cause analysis of failures.☆73Mar 14, 2021Updated 5 years ago
- Lists or removes local or remote Git branches based on last commit date and merge status.☆27Oct 9, 2020Updated 5 years ago
- Qubole Streaminglens tool for tuning Spark Structured Streaming Pipelines☆17Jan 21, 2020Updated 6 years ago
- Spark package to "plug" holes in data using SQL based rules ⚡️ 🔌☆29May 15, 2020Updated 5 years ago
- Waimak is an open-source framework that makes it easier to create complex data flows in Apache Spark.☆76Apr 24, 2024Updated last year
- Nested array transformation helper extensions for Apache Spark☆37Aug 4, 2023Updated 2 years ago
- Apache Amaterasu☆56Oct 18, 2019Updated 6 years ago
- A collection of Apache Parquet add-on modules☆30Mar 3, 2026Updated 2 weeks ago
- Smart Automation Tool for building modern Data Lakes and Data Pipelines☆122Updated this week
- A library that converts JSON Schema to Scala Case Classes☆29Apr 27, 2025Updated 10 months ago
- low-level helpers for Apache Spark libraries and tests☆16Dec 29, 2018Updated 7 years ago
- Gives TreeLog a GUI, the ScalaJS ReactTreeView☆10Jun 23, 2016Updated 9 years ago
- Apache-Spark based Data Flow(ETL) Framework which supports multiple read, write destinations of different types and also support multiple…☆26Jun 7, 2021Updated 4 years ago
- R COBOL DI (Data Integration) Package : Import COBOL CopyBook data files directly into R as properly structured data frames.☆15Aug 7, 2024Updated last year
- Java implementation of the Microsoft's AdPredictor algorithm☆17Mar 19, 2018Updated 8 years ago
- Common utilities for Apache Kafka☆36Aug 7, 2023Updated 2 years ago
- A tool to validate data, built around Apache Spark.☆101Feb 19, 2026Updated last month
- Big Data Processing Framework - Unified Data API or SQL on Any Storage☆251Jul 10, 2025Updated 8 months ago
- A library that brings useful functions from various modern database management systems to Apache Spark☆61Sep 4, 2023Updated 2 years ago
- Ultra-high-performance local IPC framework with Zipkin tracing to conduct a beautiful symphony of (brotherhood) build tooling.☆10Jan 8, 2021Updated 5 years ago
- Euphoria is an open source Java API for creating unified big-data processing flows. It provides an engine independent programming model w…☆81Nov 15, 2022Updated 3 years ago
- A framework for systematically quality controlling big data.☆40Mar 13, 2023Updated 3 years ago
- Sample processing code using Spark 2.1+ and Scala☆51Jun 28, 2020Updated 5 years ago
- Opinionated configuration files powered by Ansible.☆35Dec 31, 2018Updated 7 years ago
- Executable script for pony voice synthesis project☆11Jun 21, 2022Updated 3 years ago
- an open source dataworks platform☆21Jun 4, 2021Updated 4 years ago
- ☆45Apr 27, 2020Updated 5 years ago
- Multi-stage, config driven, SQL based ETL framework using PySpark☆26Sep 16, 2019Updated 6 years ago
- Templates for projects based on top of H2O.☆38Mar 17, 2025Updated last year
- Cortex.dev ML Serving Client for Python with garbage API collection.☆15Apr 26, 2023Updated 2 years ago
- Maelstrom is an open source Kafka integration with Spark that is designed to be developer friendly, high performance (millisecond stream …☆22Feb 6, 2017Updated 9 years ago