apache / beamLinks
Apache Beam is a unified programming model for Batch and Streaming data processing.
☆8,434Updated this week
Alternatives and similar repositories for beam
Users that are interested in beam are comparing it to the libraries listed below
Sorting:
- Apache Pinot - A realtime distributed OLAP datastore☆6,007Updated this week
- An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Tr…☆8,512Updated this week
- Web-based notebook that enables data-driven, interactive data analytics and collaborative documents with SQL, Scala and more.☆6,598Updated this week
- The official home of the Presto distributed SQL query engine for big data☆16,618Updated this week
- Apache Iceberg☆8,413Updated this week
- Upserts, Deletes And Incremental Processing on Big Data.☆6,058Updated this week
- A Scala API for Apache Beam and Google Cloud Dataflow.☆2,613Updated this week
- Apache Parquet Java☆3,007Updated this week
- Apache Druid: a high performance real-time analytics database.☆13,913Updated this week
- Apache Drill is a distributed MPP query layer for self describing data☆2,003Updated 2 months ago
- A distributed data integration framework that simplifies common aspects of big data integration such as data ingestion, replication, orga…☆2,258Updated 3 weeks ago
- Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics☆16,341Updated this week
- Apache Calcite☆5,020Updated last week
- Apache Hive☆5,971Updated last week
- Apache Flink☆25,690Updated this week
- Apache Ignite☆5,028Updated last week
- Apache Storm☆6,670Updated this week
- Cloud Dataflow Google-provided templates for solving in-Cloud data tasks☆1,262Updated this week
- Alluxio, data orchestration for analytics and machine learning in the cloud☆7,139Updated 8 months ago
- ☆1,686Updated 3 weeks ago
- Apache NiFi☆5,897Updated this week
- Azkaban workflow manager.☆4,521Updated last year
- Apache Pulsar - distributed pub-sub messaging system☆15,038Updated this week
- Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.☆3,567Updated 2 months ago
- Apache Avro is a data serialization system.☆3,203Updated last week
- Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)☆12,388Updated this week
- Apache Parquet Format☆2,176Updated 2 weeks ago
- Apache Airflow - A platform to programmatically author, schedule, and monitor workflows☆43,722Updated last week
- Apache Spark - A unified analytics engine for large-scale data processing☆42,589Updated last week
- REST job server for Apache Spark☆2,847Updated 6 months ago