apache / beam
Apache Beam is a unified programming model for Batch and Streaming data processing.
☆7,982Updated this week
Alternatives and similar repositories for beam:
Users that are interested in beam are comparing it to the libraries listed below
- Apache Iceberg☆6,851Updated this week
- Upserts, Deletes And Incremental Processing on Big Data.☆5,628Updated this week
- An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Tr…☆7,793Updated this week
- Apache Hive☆5,619Updated this week
- Apache Druid: a high performance real-time analytics database.☆13,599Updated this week
- Apache Parquet Java☆2,704Updated this week
- A Scala API for Apache Beam and Google Cloud Dataflow.☆2,576Updated this week
- Apache Flink☆24,472Updated this week
- Web-based notebook that enables data-driven, interactive data analytics and collaborative documents with SQL, Scala and more.☆6,454Updated 2 weeks ago
- The official home of the Presto distributed SQL query engine for big data☆16,191Updated this week
- Apache Pinot - A realtime distributed OLAP datastore☆5,624Updated this week
- Apache Avro is a data serialization system.☆2,993Updated this week
- A distributed data integration framework that simplifies common aspects of big data integration such as data ingestion, replication, orga…☆2,231Updated this week
- Apache Calcite☆4,716Updated this week
- Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)☆10,779Updated this week
- Apache Parquet Format☆1,870Updated 3 weeks ago
- Apache Kylin☆3,674Updated 2 weeks ago
- ☆1,620Updated 3 weeks ago
- Mirror of Apache Kudu☆1,859Updated this week
- Apache HBase☆5,275Updated this week
- Apache Drill is a distributed MPP query layer for self describing data☆1,953Updated last week
- Mirror of Apache Kafka☆29,379Updated this week
- Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics☆14,950Updated this week
- Amundsen is a metadata driven application for improving the productivity of data analysts, data scientists and engineers when interacting…☆4,489Updated this week
- Apache Pulsar - distributed pub-sub messaging system☆14,423Updated this week
- Apache Ignite☆4,864Updated this week
- Azkaban workflow manager.☆4,485Updated 7 months ago
- Apache NiFi☆5,068Updated this week
- Change data capture for a variety of databases. Please log issues at https://issues.redhat.com/browse/DBZ.☆11,020Updated this week
- Apache Flume is a distributed, reliable, and available service for efficiently collecting, aggregating, and moving large amounts of log-l…☆2,546Updated 3 months ago