jeoffreylim / maelstrom
Maelstrom is an open source Kafka integration with Spark that is designed to be developer friendly, high performance (millisecond stream processing), scalable (consumes messges at Spark worker nodes), and is extremely reliable.
☆22Updated 8 years ago
Alternatives and similar repositories for maelstrom
Users that are interested in maelstrom are comparing it to the libraries listed below
Sorting:
- A High Performance Cluster Consumer for Kafka that creates Avro (boom) files in Hadoop in time based directory paths☆42Updated 8 years ago
- Collection of generic Apache Flink operators☆17Updated 8 years ago
- A library for strong, schema based conversion between 'natural' JSON documents and Avro☆18Updated last year
- SamzaSQL: Streaming SQL implementation on top of Apache Samza and Apache Kafka☆29Updated 8 years ago
- Spooker is a dynamic framework for processing high volume data streams via processing pipelines☆29Updated 9 years ago
- Flink Examples☆39Updated 9 years ago
- Schema Registry integration for Apache Spark☆40Updated 2 years ago
- Post: Kafka - Rewind Consumer Offset☆23Updated 2 years ago
- An example of using Flink for Fault-Tolerant Stream Processing☆12Updated 6 years ago
- Cascading on Apache Flink®☆54Updated last year
- ☆26Updated 5 years ago
- Camus Compressor merges files created by Camus and saves them in a compressed format.☆12Updated 2 years ago
- Common utilities for Apache Kafka☆36Updated last year
- Library and a Framework for building fast, scalable, fault-tolerant Data APIs based on Akka, Avro, ZooKeeper and Kafka☆25Updated 4 years ago
- HDFS compatible Distributed Filesystem backed Cassandra☆25Updated 9 years ago
- High performance HBase / Spark SQL engine☆28Updated 2 years ago
- This is a simple CEP Engine leveraging the Kafka Streams platform☆16Updated 8 years ago
- Very fast & efficient grep for Kafka stream☆41Updated 9 years ago
- Mirror of Apache DirectMemory☆52Updated last year
- ☆40Updated 9 years ago
- Starter project for building MemSQL Streamliner Pipelines☆32Updated 8 years ago
- elasticsearch discovery plugin using akka cluster☆55Updated 9 years ago
- Yet Another Spark SQL JDBC/ODBC server based on the PostgreSQL V3 protocol☆34Updated 2 years ago
- The Scala Rule Engine☆41Updated 3 years ago
- Collection of HDP Tuning Tricks & Tips (unofficial guide)☆17Updated 7 years ago
- A library for financial and time series calculations on Apache Spark☆28Updated 9 years ago
- A sink to save Spark Structured Streaming DataFrame into Hive table☆23Updated 7 years ago
- Flink performance tests☆28Updated 5 years ago
- Kafka InfluxDB Metrics Reporter☆22Updated 6 years ago
- Set of extensions for kafka connect hdfs☆11Updated 4 years ago