amzn / milan
Milan is a Scala API and runtime infrastructure for building data-oriented systems, built on top of Apache Flink.
☆39Updated last year
Alternatives and similar repositories for milan:
Users that are interested in milan are comparing it to the libraries listed below
- Dependency and data pipeline management framework for Spark and Scala☆15Updated 7 years ago
- ☆23Updated 3 months ago
- Spark Structured Streaming State Tools☆34Updated 4 years ago
- Spark package to "plug" holes in data using SQL based rules ⚡️ 🔌☆28Updated 4 years ago
- Peel is a framework that helps you to define, execute, analyze, and share experiments for distributed systems and algorithms.☆27Updated 2 years ago
- Scala Aggregators used for ML Model metrics monitoring☆91Updated last year
- Paper: A Zero-rename committer for object stores☆20Updated 3 years ago
- Miscellaneous functionality for manipulating Apache Spark RDDs.☆22Updated 6 years ago
- A library that brings useful functions from various modern database management systems to Apache Spark☆58Updated last year
- Routines and data structures for using isarn-sketches idiomatically in Apache Spark☆29Updated 10 months ago
- A quotation-based Scala DSL for scalable data analysis.☆63Updated 2 years ago
- A framework for systematically quality controlling big data.☆41Updated 2 years ago
- Example program that writes Parquet formatted data to plain files (i.e., not Hadoop hdfs); Parquet is a columnar storage format.☆38Updated 2 years ago
- Scoring ONNX models on the JVM in scala☆69Updated 3 years ago
- Cascading on Apache Flink®☆54Updated last year
- Spark MLlib code optimized to efficiently support sparse data☆51Updated 8 years ago
- Lighthouse is a library for data lakes built on top of Apache Spark. It provides high-level APIs in Scala to streamline data pipelines an…☆61Updated 6 months ago
- A library for exporting Spark ML models and pipelines to PFA☆54Updated 6 years ago
- Apache Spark under Docker☆9Updated 8 years ago
- Library for organizing batch processing pipelines in Apache Spark☆41Updated 8 years ago
- Dione - a Spark and HDFS indexing library☆51Updated last year
- Scriptable scheduler for periodical Hadoop workflows☆22Updated 7 years ago
- Distributed Matrix Library☆71Updated 8 years ago
- Data Science with Apache Spark and Spark Notebook☆30Updated 7 years ago
- Alchemist: an Apache Spark<->MPI interface☆26Updated 6 years ago
- Spark Parameter Optimization and Tuning☆31Updated 6 years ago
- Data Sketches for Apache Spark☆22Updated 2 years ago
- Bulletproof Apache Spark jobs with fast root cause analysis of failures.☆72Updated 4 years ago
- A framework for creating composable and pluggable data processing pipelines using Apache Spark, and running them on a cluster.☆47Updated 8 years ago
- Swimlane graphs for Hive, SparkSQL, and Presto based on Ganglia resource graphs☆12Updated 8 years ago