apache / gobblin
A distributed data integration framework that simplifies common aspects of big data integration such as data ingestion, replication, organization and lifecycle management for both streaming and batch data ecosystems.
☆2,237Updated this week
Alternatives and similar repositories for gobblin:
Users that are interested in gobblin are comparing it to the libraries listed below
- Apache Drill is a distributed MPP query layer for self describing data☆1,964Updated 2 weeks ago
- LinkedIn's previous generation Kafka to HDFS pipeline.☆876Updated 4 years ago
- Dr. Elephant is a job and flow-level performance monitoring and tuning tool for Apache Hadoop and Apache Spark☆1,354Updated last year
- Mirror of Apache Kudu☆1,869Updated this week
- Real-time Query for Hadoop; mirror of Apache Impala☆34Updated 2 years ago
- SQL-based streaming analytics platform at scale☆1,223Updated 4 years ago
- ☆1,645Updated this week
- Apache Phoenix☆1,037Updated last week
- Apache Flume is a distributed, reliable, and available service for efficiently collecting, aggregating, and moving large amounts of log-l…☆2,550Updated 6 months ago
- Tranquility helps you send real-time event streams to Druid and handles partitioning, replication, service discovery, and schema rollover…☆516Updated 5 years ago
- Mirror of Apache Sqoop☆978Updated 4 years ago
- Project SnappyData - memory optimized analytics database, based on Apache Spark™ and Apache Geode™. Stream, Transact, Analyze, Predict in…☆1,037Updated 2 years ago
- Mirror of Apache Samza☆823Updated last month
- Source-agnostic distributed change data capture system☆3,659Updated last year
- Apache BookKeeper - a scalable, fault tolerant and low latency storage service optimized for append-only workloads☆1,927Updated this week
- Apache Impala☆1,204Updated this week
- Mirror of Apache Oozie☆723Updated 2 months ago
- Apache Pinot - A realtime distributed OLAP datastore☆5,751Updated this week
- Elasticsearch real-time search and analytics natively integrated with Hadoop☆1,938Updated last week
- Apache Kylin☆3,688Updated 2 weeks ago
- High performance data store solution☆1,435Updated 3 weeks ago
- Apache Ranger - To enable, monitor and manage comprehensive data security across the Hadoop platform and beyond☆948Updated this week
- A connector for Spark that allows reading and writing to/from Redis cluster☆947Updated 6 months ago
- Azkaban workflow manager.☆4,492Updated 9 months ago
- REST job server for Apache Spark☆2,836Updated 3 months ago
- Apache Atlas - Open Metadata Management and Governance capabilities across the Hadoop platform and beyond☆1,929Updated last week
- Apache Tez☆493Updated 3 weeks ago
- Livy is an open source REST interface for interacting with Apache Spark from anywhere☆1,007Updated 2 years ago
- Kylo is a data lake management software platform and framework for enabling scalable enterprise-class data lakes on big data technologies…☆1,111Updated 2 years ago
- Upserts, Deletes And Incremental Processing on Big Data.☆5,749Updated this week