apache / beam
Apache Beam is a unified programming model for Batch and Streaming data processing.
☆8,086Updated this week
Alternatives and similar repositories for beam:
Users that are interested in beam are comparing it to the libraries listed below
- Web-based notebook that enables data-driven, interactive data analytics and collaborative documents with SQL, Scala and more.☆6,480Updated last week
- Apache Hive☆5,698Updated this week
- Apache Druid: a high performance real-time analytics database.☆13,691Updated this week
- Apache Iceberg☆7,309Updated this week
- Apache Flink☆24,836Updated this week
- Upserts, Deletes And Incremental Processing on Big Data.☆5,755Updated this week
- Apache Pinot - A realtime distributed OLAP datastore☆5,764Updated this week
- Apache Storm☆6,620Updated this week
- Apache Parquet Java☆2,803Updated this week
- An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Tr…☆7,997Updated this week
- Alluxio, data orchestration for analytics and machine learning in the cloud☆6,980Updated last week
- Azkaban workflow manager.☆4,495Updated 10 months ago
- The official home of the Presto distributed SQL query engine for big data☆16,325Updated this week
- Apache Drill is a distributed MPP query layer for self describing data☆1,969Updated 3 weeks ago
- Apache Airflow - A platform to programmatically author, schedule, and monitor workflows☆39,921Updated this week
- Apache Cassandra®☆9,176Updated this week
- Cloud Dataflow Google-provided templates for solving in-Cloud data tasks☆1,200Updated this week
- Apache Ignite☆4,924Updated this week
- Apache HBase☆5,334Updated this week
- Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)☆11,235Updated this week
- Apache NiFi☆5,305Updated this week
- Apache Calcite☆4,813Updated this week
- Apache Spark - A unified analytics engine for large-scale data processing☆41,047Updated this week
- Apache Flume is a distributed, reliable, and available service for efficiently collecting, aggregating, and moving large amounts of log-l…☆2,551Updated 6 months ago
- Apache Parquet Format☆1,942Updated 3 weeks ago
- Apache Heron (Incubating) is a realtime, distributed, fault-tolerant stream processing engine from Twitter☆3,624Updated 2 years ago
- Apache Hadoop☆15,065Updated this week
- Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics☆15,335Updated this week
- A distributed data integration framework that simplifies common aspects of big data integration such as data ingestion, replication, orga…☆2,238Updated this week
- Apache Pulsar - distributed pub-sub messaging system☆14,595Updated this week