apache / gobblin
A distributed data integration framework that simplifies common aspects of big data integration such as data ingestion, replication, organization and lifecycle management for both streaming and batch data ecosystems.
☆2,237Updated last week
Alternatives and similar repositories for gobblin:
Users that are interested in gobblin are comparing it to the libraries listed below
- Dr. Elephant is a job and flow-level performance monitoring and tuning tool for Apache Hadoop and Apache Spark☆1,354Updated last year
- LinkedIn's previous generation Kafka to HDFS pipeline.☆876Updated 4 years ago
- Apache Drill is a distributed MPP query layer for self describing data☆1,960Updated this week
- SQL-based streaming analytics platform at scale☆1,223Updated 4 years ago
- Mirror of Apache Kudu☆1,862Updated this week
- ☆1,630Updated this week
- Apache Phoenix☆1,036Updated this week
- Tranquility helps you send real-time event streams to Druid and handles partitioning, replication, service discovery, and schema rollover…☆516Updated 5 years ago
- Project SnappyData - memory optimized analytics database, based on Apache Spark™ and Apache Geode™. Stream, Transact, Analyze, Predict in…☆1,037Updated 2 years ago
- Real-time Query for Hadoop; mirror of Apache Impala☆34Updated 2 years ago
- Apache Flume is a distributed, reliable, and available service for efficiently collecting, aggregating, and moving large amounts of log-l…☆2,545Updated 5 months ago
- Mirror of Apache Oozie☆723Updated last month
- Elasticsearch real-time search and analytics natively integrated with Hadoop☆1,935Updated this week
- Mirror of Apache Samza☆823Updated 2 weeks ago
- Apache Pinot - A realtime distributed OLAP datastore☆5,668Updated this week
- Apache Parquet Java☆2,755Updated this week
- Livy is an open source REST interface for interacting with Apache Spark from anywhere☆1,005Updated 2 years ago
- Xinfra Monitor monitors the availability of Kafka clusters by producing synthetic workloads using end-to-end pipelines to obtain derived …☆2,027Updated last week
- An extensible distributed system for reliable nearline data streaming at scale☆935Updated 9 months ago
- Improvement of Apache Kafka Mirrormaker☆919Updated last year
- Kylo is a data lake management software platform and framework for enabling scalable enterprise-class data lakes on big data technologies…☆1,111Updated 2 years ago
- Mirror of Apache Sqoop☆978Updated 3 years ago
- Apache Heron (Incubating) is a realtime, distributed, fault-tolerant stream processing engine from Twitter☆3,629Updated 2 years ago
- Pravega - Streaming as a new software defined storage primitive☆1,994Updated 2 weeks ago
- Apache Livy is an open source REST interface for interacting with Apache Spark from anywhere.☆903Updated 4 months ago
- Secor is a service implementing Kafka log persistence☆1,843Updated 3 months ago
- Apache Calcite☆4,758Updated last week
- High performance data store solution☆1,436Updated 2 weeks ago
- Distributed Prometheus time series database☆1,433Updated last week
- Apache Ranger - To enable, monitor and manage comprehensive data security across the Hadoop platform and beyond☆937Updated this week