A distributed data integration framework that simplifies common aspects of big data integration such as data ingestion, replication, organization and lifecycle management for both streaming and batch data ecosystems.
☆2,260Feb 19, 2026Updated last week
Alternatives and similar repositories for gobblin
Users that are interested in gobblin are comparing it to the libraries listed below
Sorting:
- LinkedIn's previous generation Kafka to HDFS pipeline.☆884Aug 27, 2020Updated 5 years ago
- Apache Pinot - A realtime distributed OLAP datastore☆6,032Updated this week
- Dr. Elephant is a job and flow-level performance monitoring and tuning tool for Apache Hadoop and Apache Spark☆1,371Aug 22, 2023Updated 2 years ago
- Apache Druid: a high performance real-time analytics database.☆13,942Updated this week
- Apache Heron (Incubating) is a realtime, distributed, fault-tolerant stream processing engine from Twitter☆3,700Mar 1, 2023Updated 2 years ago
- SQL-based streaming analytics platform at scale☆1,226Jun 21, 2020Updated 5 years ago
- The official home of the Presto distributed SQL query engine for big data☆16,662Updated this week
- Alluxio, data orchestration for analytics and machine learning in the cloud☆7,157Apr 29, 2025Updated 9 months ago
- Apache Kylin☆3,766Dec 29, 2025Updated last month
- ☆1,687Feb 19, 2026Updated last week
- Web-based notebook that enables data-driven, interactive data analytics and collaborative documents with SQL, Scala and more.☆6,605Updated this week
- CMAK is a tool for managing Apache Kafka clusters☆11,952Aug 2, 2023Updated 2 years ago
- The Metadata Platform for your Data and AI Stack☆11,608Updated this week
- Upserts, Deletes And Incremental Processing on Big Data.☆6,098Updated this week
- Azkaban workflow manager.☆4,515Jul 3, 2024Updated last year
- Apache Beam is a unified programming model for Batch and Streaming data processing.☆8,492Updated this week
- Kylo is a data lake management software platform and framework for enabling scalable enterprise-class data lakes on big data technologies…☆1,113Jan 12, 2023Updated 3 years ago
- Apache Drill is a distributed MPP query layer for self describing data☆2,010Jan 29, 2026Updated 3 weeks ago
- Secor is a service implementing Kafka log persistence☆1,858Feb 17, 2026Updated last week
- High performance data store solution☆1,446Updated this week
- An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Tr…☆8,602Updated this week
- REST job server for Apache Spark☆2,842Jul 8, 2025Updated 7 months ago
- Source-agnostic distributed change data capture system☆3,679Sep 28, 2023Updated 2 years ago
- Kafka Consumer Lag Checking☆3,947Jan 14, 2026Updated last month
- Mirror of Apache Kudu☆1,898Updated this week
- Mirror of Apache Helix☆493Feb 19, 2026Updated last week
- Web UI for PrestoDB.☆2,751May 20, 2021Updated 4 years ago
- Distributed Big Data Orchestration Service☆1,763Jan 31, 2026Updated last month
- Apache Flink☆25,825Updated this week
- Apache Calcite☆5,077Updated this week
- Project SnappyData - memory optimized analytics database, based on Apache Spark™ and Apache Geode™. Stream, Transact, Analyze, Predict in…☆1,036Nov 21, 2022Updated 3 years ago
- Mirror of Apache Eagle☆411Aug 22, 2020Updated 5 years ago
- Apache Ignite☆5,044Updated this week
- Xinfra Monitor monitors the availability of Kafka clusters by producing synthetic workloads using end-to-end pipelines to obtain derived …☆2,057Mar 9, 2025Updated 11 months ago
- Mirror of Apache griffin☆1,174Aug 3, 2025Updated 6 months ago
- Mirror of Apache Samza☆838May 2, 2025Updated 9 months ago
- Oryx 2: Lambda architecture on Apache Spark, Apache Kafka for real-time large scale machine learning☆1,786Aug 16, 2021Updated 4 years ago
- Pravega - Streaming as a new software defined storage primitive☆2,005Mar 2, 2025Updated 11 months ago
- Apache NiFi☆5,982Updated this week