A distributed data integration framework that simplifies common aspects of big data integration such as data ingestion, replication, organization and lifecycle management for both streaming and batch data ecosystems.
☆2,271Jul 31, 2026Updated last month
Alternatives and similar repositories for gobblin
Users that are interested in gobblin are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- LinkedIn's previous generation Kafka to HDFS pipeline.☆878Aug 27, 2020Updated 6 years ago
- Apache Pinot - A realtime distributed OLAP datastore☆6,139Updated this week
- Dr. Elephant is a job and flow-level performance monitoring and tuning tool for Apache Hadoop and Apache Spark☆1,370Aug 22, 2023Updated 3 years ago
- Apache Heron (Incubating) is a realtime, distributed, fault-tolerant stream processing engine from Twitter☆3,626Mar 1, 2023Updated 3 years ago
- Apache Druid: a high performance real-time analytics database.☆14,054Updated this week
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- The official home of the Presto distributed SQL query engine for big data☆16,739Updated this week
- SQL-based streaming analytics platform at scale☆1,222Jun 21, 2020Updated 6 years ago
- CMAK is a tool for managing Apache Kafka clusters☆11,923Aug 2, 2023Updated 3 years ago
- Azkaban workflow manager.☆4,509Jul 3, 2024Updated 2 years ago
- Apache Kylin☆3,773Sep 1, 2026Updated 2 weeks ago
- The Context Platform for your Data and AI Stack☆12,740Updated this week
- Web-based notebook that enables data-driven, interactive data analytics and collaborative documents with SQL, Scala and more.☆6,659Updated this week
- Alluxio, data orchestration for analytics and machine learning in the cloud☆7,243Sep 1, 2026Updated 2 weeks ago
- ☆1,692Updated this week
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- Upserts, Deletes And Incremental Processing on Big Data.☆6,264Updated this week
- Kafka Connect HDFS connector☆27Updated this week
- Source-agnostic distributed change data capture system☆3,683Sep 28, 2023Updated 2 years ago
- Apache Drill is a distributed MPP query layer for self describing data☆2,023Updated this week
- Secor is a service implementing Kafka log persistence☆1,858Mar 10, 2026Updated 6 months ago
- Apache Beam is a unified programming model for Batch and Streaming data processing.☆8,668Updated this week
- Kylo is a data lake management software platform and framework for enabling scalable enterprise-class data lakes on big data technologies…☆1,116Jan 12, 2023Updated 3 years ago
- Mirror of Apache Kudu☆1,914Updated this week
- REST job server for Apache Spark☆2,836Mar 3, 2026Updated 6 months ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- Apache Flink☆26,347Updated this week
- Mirror of Apache Helix☆504Updated this week
- Kafka Consumer Lag Checking☆3,961Aug 21, 2026Updated last month
- High performance data store solution☆1,452Aug 7, 2026Updated last month
- Web UI for PrestoDB.☆2,742May 20, 2021Updated 5 years ago
- An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Tr…☆9,018Updated this week
- Apache Calcite☆5,186Updated this week
- Mirror of Apache Samza☆845Sep 1, 2026Updated 2 weeks ago
- Mirror of Apache griffin☆1,172Aug 3, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Oryx 2: Lambda architecture on Apache Spark, Apache Kafka for real-time large scale machine learning☆1,782Aug 16, 2021Updated 5 years ago
- Apache Ignite☆5,086Updated this week
- Generic Data Ingestion & Dispersal Library for Hadoop☆484Mar 19, 2023Updated 3 years ago
- Xinfra Monitor monitors the availability of Kafka clusters by producing synthetic workloads using end-to-end pipelines to obtain derived …☆2,065Mar 9, 2025Updated last year
- Open source SQL Query Assistant service for Databases/Warehouses☆1,411Updated this week
- Distributed Big Data Orchestration Service☆1,766Sep 3, 2026Updated 2 weeks ago
- Confluent Schema Registry for Kafka☆2,465Updated this week