Apache Beam is a unified programming model for Batch and Streaming data processing.
☆8,492Updated this week
Alternatives and similar repositories for beam
Users that are interested in beam are comparing it to the libraries listed below
Sorting:
- Apache Flink☆25,825Updated this week
- Apache Spark - A unified analytics engine for large-scale data processing☆42,898Updated this week
- The official home of the Presto distributed SQL query engine for big data☆16,662Updated this week
- Apache Druid: a high performance real-time analytics database.☆13,942Updated this week
- Apache Iceberg☆8,572Updated this week
- Apache Airflow - A platform to programmatically author, schedule, and monitor workflows☆44,430Updated this week
- Apache Pulsar - distributed pub-sub messaging system☆15,127Updated this week
- Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics☆16,529Updated this week
- Upserts, Deletes And Incremental Processing on Big Data.☆6,098Updated this week
- An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Tr…☆8,602Updated this week
- A Scala API for Apache Beam and Google Cloud Dataflow.☆2,615Feb 12, 2026Updated 2 weeks ago
- Apache Pinot - A realtime distributed OLAP datastore☆6,032Updated this week
- Apache Calcite☆5,077Updated this week
- Mirror of Apache Kafka☆32,065Updated this week
- Alluxio, data orchestration for analytics and machine learning in the cloud☆7,157Apr 29, 2025Updated 9 months ago
- Apache NiFi☆5,982Updated this week
- Web-based notebook that enables data-driven, interactive data analytics and collaborative documents with SQL, Scala and more.☆6,605Updated this week
- Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)☆12,592Updated this week
- Apache Kylin☆3,766Dec 29, 2025Updated last month
- Apache Ignite☆5,044Updated this week
- Change data capture for a variety of databases. Please log issues at https://github.com/debezium/dbz/issues.☆12,434Updated this week
- A distributed data integration framework that simplifies common aspects of big data integration such as data ingestion, replication, orga…☆2,260Feb 19, 2026Updated last week
- Apache Hive☆6,002Updated this week
- Machine Learning Toolkit for Kubernetes☆15,462Jan 5, 2026Updated last month
- Apache Doris is an easy-to-use, high performance and unified analytics database.☆15,036Updated this week
- Apache Heron (Incubating) is a realtime, distributed, fault-tolerant stream processing engine from Twitter☆3,700Mar 1, 2023Updated 2 years ago
- Apache Superset is a Data Visualization and Data Exploration Platform☆70,661Updated this week
- The Metadata Platform for your Data and AI Stack☆11,608Updated this week
- Apache Drill is a distributed MPP query layer for self describing data☆2,010Jan 29, 2026Updated 3 weeks ago
- A library that provides an embeddable, persistent key-value store for fast storage.☆31,566Updated this week
- ClickHouse® is a real-time analytics database management system☆46,035Updated this week
- Apache Parquet Java☆3,025Updated this week
- Apache Cassandra®☆9,644Updated this week
- Apache HBase☆5,588Updated this week
- Apache Storm☆6,671Feb 4, 2026Updated 3 weeks ago
- Connect, secure, control, and observe services.☆38,042Updated this week
- Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.☆41,413Feb 21, 2026Updated last week
- Apache Avro is a data serialization system.☆3,228Updated this week
- Mirror of Apache Samza☆838May 2, 2025Updated 9 months ago