jeoffreylim / maelstromLinks
Maelstrom is an open source Kafka integration with Spark that is designed to be developer friendly, high performance (millisecond stream processing), scalable (consumes messges at Spark worker nodes), and is extremely reliable.
☆22Updated 8 years ago
Alternatives and similar repositories for maelstrom
Users that are interested in maelstrom are comparing it to the libraries listed below
Sorting:
- Spooker is a dynamic framework for processing high volume data streams via processing pipelines☆30Updated 9 years ago
- An example of using Flink for Fault-Tolerant Stream Processing☆12Updated 6 years ago
- Common utilities for Apache Kafka☆36Updated 2 years ago
- A library for strong, schema based conversion between 'natural' JSON documents and Avro☆18Updated last year
- SamzaSQL: Streaming SQL implementation on top of Apache Samza and Apache Kafka☆29Updated 9 years ago
- Collection of generic Apache Flink operators☆17Updated 8 years ago
- Flink Examples☆38Updated 9 years ago
- A High Performance Cluster Consumer for Kafka that creates Avro (boom) files in Hadoop in time based directory paths☆42Updated 9 years ago
- A library for financial and time series calculations on Apache Spark☆28Updated 9 years ago
- A set of tools to ease working with Zookeeper and Kafka.☆23Updated 9 years ago
- ☆26Updated 5 years ago
- UberScriptQuery, a SQL-like DSL to make writing Spark jobs super easy☆63Updated last year
- Sql interface to druid.☆77Updated 9 years ago
- Cascading on Apache Flink®☆54Updated last year
- Flink performance tests☆28Updated 6 years ago
- Yet Another Spark SQL JDBC/ODBC server based on the PostgreSQL V3 protocol☆34Updated 3 years ago
- Schema Registry integration for Apache Spark☆40Updated 3 years ago
- Quark is a data virtualization engine over analytic databases.☆100Updated 8 years ago
- A light Kafka to HDFS/S3 ETL library based on Apache Spark☆40Updated 8 years ago
- High performance HBase / Spark SQL engine☆28Updated 3 years ago
- Code examples for my blog posts☆22Updated 7 years ago
- JDBC driver that converts any INSERT, UPDATE and DELETE statements into append-only INSERTs. Instead of updating rows in-place it inserts…☆82Updated 8 years ago
- Camus Compressor merges files created by Camus and saves them in a compressed format.☆13Updated 2 years ago
- Demonstration of a Hive Input Format for Iceberg☆26Updated 4 years ago
- Spark CEP is an extension of Spark Streaming to support SQL-based query processing☆57Updated 8 years ago
- Java event logs collector for hadoop and frameworks☆41Updated 8 months ago
- Euphoria is an open source Java API for creating unified big-data processing flows. It provides an engine independent programming model w…☆83Updated 3 years ago
- Library and a Framework for building fast, scalable, fault-tolerant Data APIs based on Akka, Avro, ZooKeeper and Kafka☆25Updated 5 years ago
- Mirror of Apache DirectMemory☆53Updated last year
- A streaming key-value store implementation using native Flink Streaming operators☆23Updated 10 years ago