Maelstrom is an open source Kafka integration with Spark that is designed to be developer friendly, high performance (millisecond stream processing), scalable (consumes messges at Spark worker nodes), and is extremely reliable.
☆21Feb 6, 2017Updated 9 years ago
Alternatives and similar repositories for maelstrom
Users that are interested in maelstrom are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A parser for haproxy logs in Python☆14Feb 13, 2011Updated 15 years ago
- Distributed SQL base Realtime Streaming Computation Framework On Apache Storm, Spark☆12Mar 14, 2016Updated 10 years ago
- Library and a Framework for building fast, scalable, fault-tolerant Data APIs based on Akka, Avro, ZooKeeper and Kafka☆25Oct 16, 2020Updated 5 years ago
- Open source task scheduler with dependency management☆15Jul 1, 2018Updated 8 years ago
- Spark package to "plug" holes in data using SQL based rules ⚡️ 🔌☆28May 15, 2020Updated 6 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- This is a simple CEP Engine leveraging the Kafka Streams platform☆16Apr 25, 2017Updated 9 years ago
- Spark CEP is an extension of Spark Streaming to support SQL-based query processing☆58Apr 12, 2017Updated 9 years ago
- A file system backed by AntidoteDB.☆13Jun 10, 2021Updated 5 years ago
- Open-source distribute workflow schedule tools, also support streaming task.☆40Nov 11, 2017Updated 8 years ago
- DataStax Enterprise (DSE) Deployment Guide for Google Cloud Platform (GCP)☆10Apr 10, 2020Updated 6 years ago
- Scala API for Apache Spark SQL high-order functions☆15Aug 4, 2023Updated 3 years ago
- Temporal_Graph_library☆25Feb 2, 2019Updated 7 years ago
- A set of tools to ease working with Zookeeper and Kafka.☆23Jan 22, 2016Updated 10 years ago
- Plot live-stats as graph from ApacheSpark application using Lightning-viz☆18Jul 3, 2017Updated 9 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A distributed generic query layer for Apache Kafka Interactive Queries☆26Nov 8, 2017Updated 8 years ago
- Demonstration of a Hive Input Format for Iceberg☆26Mar 12, 2021Updated 5 years ago
- A core AST and utilities to manipulate geographical data☆21Sep 30, 2022Updated 4 years ago
- THIS REPOSITORY IS DEPRECATED☆19Jul 6, 2023Updated 3 years ago
- Cassandra state implementation for Twitter Storm Trident API☆17Jan 21, 2013Updated 13 years ago
- ☆51Jul 24, 2026Updated 2 months ago
- A minimal seed template for an Akka gRPC with Scala build☆19Sep 10, 2026Updated 3 weeks ago
- Parallel Streaming Transformation Loader☆10Apr 23, 2019Updated 7 years ago
- Presto connector for Apache Kudu☆48Mar 22, 2019Updated 7 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Protobuf serialization support for Apache Flink☆22Jun 1, 2021Updated 5 years ago
- Develop streaming applications for IBM Streams in Python, Java & Scala.☆29Jul 24, 2022Updated 4 years ago
- an open source dataworks platform☆20Jun 4, 2021Updated 5 years ago
- Framework for running macro benchmarks in a clustered environment☆25Aug 29, 2022Updated 4 years ago
- Monitoring cassandra cluster by ELK (Elasticsearch , logstash and Kibana)☆20Mar 16, 2017Updated 9 years ago
- UberScriptQuery, a SQL-like DSL to make writing Spark jobs super easy☆65Dec 17, 2023Updated 2 years ago
- Flink performance tests☆29Nov 13, 2019Updated 6 years ago
- A pretty dsl on top of nodeunit.☆19Sep 27, 2011Updated 15 years ago
- Example code for building your own MemSQL Streamliner Pipelines☆23Apr 18, 2017Updated 9 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Serverless proxy for Spark cluster☆325Apr 13, 2026Updated 5 months ago
- akkaflow是一个基于akka架构上构建的分布式高可用DAG工作流调度工具，可以把子节点分配在集群机器 上并行执行，高效利用集群资源。☆106Sep 14, 2019Updated 7 years ago
- Zephyr is a big data, platform agnostic ETL API, with Hadoop MapReduce, Storm, and other big data bindings.☆22Jan 21, 2016Updated 10 years ago
- Web Based Kafka Consumer and Producer☆70Jan 29, 2020Updated 6 years ago
- Be a silentor,just focus on mark your words down!☆12Jul 18, 2015Updated 11 years ago
- Fast, reliable, and scalable channels implementation based on Redis streams.☆11Jun 25, 2024Updated 2 years ago
- li-apache-kafka-clients is a wrapper library for the Apache Kafka vanilla clients. It provides additional features such as large message …☆137Jul 7, 2023Updated 3 years ago