Spark package to "plug" holes in data using SQL based rules ⚡️ 🔌
☆29May 15, 2020Updated 5 years ago
Alternatives and similar repositories for sparkplug
Users that are interested in sparkplug are comparing it to the libraries listed below
Sorting:
- Schema registry for CSV, TSV, JSON, AVRO and Parquet schema. Supports schema inference and GraphQL API.☆115Mar 5, 2020Updated 6 years ago
- Library and a Framework for building fast, scalable, fault-tolerant Data APIs based on Akka, Avro, ZooKeeper and Kafka☆24Oct 16, 2020Updated 5 years ago
- ☆14Jul 26, 2019Updated 6 years ago
- Scala Library for Reading Flat File Data (CSV/TSV/XLS/XLSX)☆11Jul 13, 2023Updated 2 years ago
- This toolkit provides an implementation of Modified Adsorption (MAD), a graph-based semi-supervised learning (SSL) algorithm.☆24Jun 20, 2017Updated 8 years ago
- Scala API for Apache Spark SQL high-order functions☆14Aug 4, 2023Updated 2 years ago
- Google Maps geocoding library for Scala☆12Oct 12, 2019Updated 6 years ago
- A dynamic data completeness and accuracy library at enterprise scale for Apache Spark☆29Nov 4, 2024Updated last year
- Maelstrom is an open source Kafka integration with Spark that is designed to be developer friendly, high performance (millisecond stream …☆22Feb 6, 2017Updated 9 years ago
- Immutable DataTable implementation in Scala☆70Dec 30, 2019Updated 6 years ago
- Large-scale event processing with Akka Persistence and Apache Spark☆273Jun 18, 2016Updated 9 years ago
- Open source task scheduler with dependency management☆15Jul 1, 2018Updated 7 years ago
- Redis search and indexing in Java☆16Sep 26, 2016Updated 9 years ago
- A collection of Apache Parquet add-on modules☆30Mar 3, 2026Updated 2 weeks ago
- ☆11Nov 15, 2016Updated 9 years ago
- Scala, DSL, Rules based reactive workflows and Microservices☆14Oct 20, 2025Updated 5 months ago
- Scala Math - Numerical (Matlab-like) and Symbolic (Mathematica-like) tool☆71Nov 25, 2019Updated 6 years ago
- Scala wrappers for MapDB☆12Sep 9, 2017Updated 8 years ago
- Build universally reusable web fragments on the JVM☆26Dec 5, 2023Updated 2 years ago
- ScalaJS Facade for Vue.js☆16Sep 10, 2017Updated 8 years ago
- Scala library for accessing various file, batch systems, job schedulers and grid middlewares.☆28Nov 26, 2025Updated 3 months ago
- ☆13Nov 20, 2016Updated 9 years ago
- Typesafe, purely functional Computational Intelligence☆124Aug 5, 2022Updated 3 years ago
- Library for building reproducible data pipelines to support experimentation☆20Dec 16, 2015Updated 10 years ago
- Purely functional genetic algorithms for multi-objective optimisation☆74Mar 5, 2026Updated 2 weeks ago
- N-dimensional / multi-dimensional arrays (tensors) in Scala 3. Think NumPy ndarray / PyTorch Tensor but type-safe over shapes, array/axis…☆47Dec 22, 2022Updated 3 years ago
- Apache-Spark based Data Flow(ETL) Framework which supports multiple read, write destinations of different types and also support multiple…☆26Jun 7, 2021Updated 4 years ago
- An extremely barebones boilerplate project for compiling Kotlin to Javascript☆10May 25, 2017Updated 8 years ago
- UberScriptQuery, a SQL-like DSL to make writing Spark jobs super easy☆64Dec 17, 2023Updated 2 years ago
- A library that brings useful functions from various modern database management systems to Apache Spark☆61Sep 4, 2023Updated 2 years ago
- Efficient diffing in Scala☆61Nov 4, 2025Updated 4 months ago
- A collection of tools for Golang☆16Mar 27, 2019Updated 6 years ago
- Plot live-stats as graph from ApacheSpark application using Lightning-viz☆18Jul 3, 2017Updated 8 years ago
- Make your joins typesafe again☆26Feb 5, 2026Updated last month
- A Scala Collection for Multiple Access Patterns☆12Oct 22, 2016Updated 9 years ago
- An sbt plugin to fix java.lang.OutOfMemoryError: Metaspace/PermGen errors during interactive sbt usage☆14Feb 16, 2017Updated 9 years ago
- Fancy logging library for Scala☆60Dec 4, 2017Updated 8 years ago
- Data-ish exploration through SQL+Uncertainty☆27Oct 31, 2022Updated 3 years ago
- Generate mock data based on an Apache Avro schema and specific cardinality settings☆10Apr 16, 2018Updated 7 years ago