jeoffreylim / maelstromLinks
Maelstrom is an open source Kafka integration with Spark that is designed to be developer friendly, high performance (millisecond stream processing), scalable (consumes messges at Spark worker nodes), and is extremely reliable.
☆22Updated 8 years ago
Alternatives and similar repositories for maelstrom
Users that are interested in maelstrom are comparing it to the libraries listed below
Sorting:
- A High Performance Cluster Consumer for Kafka that creates Avro (boom) files in Hadoop in time based directory paths☆42Updated 9 years ago
- A library for strong, schema based conversion between 'natural' JSON documents and Avro☆18Updated last year
- Flink performance tests☆28Updated 5 years ago
- Camus Compressor merges files created by Camus and saves them in a compressed format.☆14Updated 2 years ago
- Spooker is a dynamic framework for processing high volume data streams via processing pipelines☆29Updated 9 years ago
- ☆26Updated 5 years ago
- Collection of generic Apache Flink operators☆17Updated 8 years ago
- Cascading on Apache Flink®☆54Updated last year
- Common utilities for Apache Kafka☆36Updated last year
- Schema Registry integration for Apache Spark☆40Updated 2 years ago
- SamzaSQL: Streaming SQL implementation on top of Apache Samza and Apache Kafka☆29Updated 9 years ago
- Yet Another Spark SQL JDBC/ODBC server based on the PostgreSQL V3 protocol☆34Updated 2 years ago
- Flink Examples☆39Updated 9 years ago
- A streaming key-value store implementation using native Flink Streaming operators☆23Updated 9 years ago
- Sql interface to druid.☆77Updated 9 years ago
- An example of using Flink for Fault-Tolerant Stream Processing☆12Updated 6 years ago
- A set of tools to ease working with Zookeeper and Kafka.☆23Updated 9 years ago
- Mirror of Apache DirectMemory☆52Updated last year
- Kafka Connect Integration with Kafka Streams + KSQL☆11Updated 6 years ago
- UberScriptQuery, a SQL-like DSL to make writing Spark jobs super easy☆61Updated last year
- spark structured streaming via HTTP communication☆18Updated 3 years ago
- Akka persistance plugin implementation with Apache Ignite☆21Updated 6 years ago
- A light Kafka to HDFS/S3 ETL library based on Apache Spark☆41Updated 8 years ago
- A library for financial and time series calculations on Apache Spark☆28Updated 9 years ago
- Quark is a data virtualization engine over analytic databases.☆98Updated 7 years ago
- A sink to save Spark Structured Streaming DataFrame into Hive table☆23Updated 7 years ago
- Starter project for building MemSQL Streamliner Pipelines☆32Updated 8 years ago
- A bunch of utility classes for Java, Hadoop, HBase, Pig, etc.☆76Updated 11 years ago
- Demonstration of a Hive Input Format for Iceberg☆26Updated 4 years ago
- A distributed generic query layer for Apache Kafka Interactive Queries☆26Updated 7 years ago