Hadoop Job for schemaless incremental loading of messages from Kafka topics onto hdfs with configurable output partitioning.
☆91Oct 2, 2016Updated 9 years ago
Alternatives and similar repositories for kafka-hadoop-loader
Users that are interested in kafka-hadoop-loader are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A High Performance Cluster Consumer for Kafka that creates Avro (boom) files in Hadoop in time based directory paths☆42Jun 3, 2016Updated 9 years ago
- 平时玩hadoop做的例子。☆10Feb 15, 2017Updated 9 years ago
- Scripts for running Apache Kafka on Mesosphere's Marathon☆14Dec 6, 2015Updated 10 years ago
- Java client to connect directly to Impala using thrift☆33Apr 12, 2017Updated 8 years ago
- 一个为spark批量导入数据到hbase的库☆42Nov 18, 2016Updated 9 years ago
- DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Open Source, Distributed, RESTful Search Engine☆11Aug 18, 2024Updated last year
- LinkedIn's previous generation Kafka to HDFS pipeline.☆882Aug 27, 2020Updated 5 years ago
- Kafka on Mesos☆33Aug 23, 2015Updated 10 years ago
- ☆12Jun 9, 2021Updated 4 years ago
- Redis search and indexing in Java☆16Sep 26, 2016Updated 9 years ago
- ☆10Nov 23, 2020Updated 5 years ago
- Python tools to examine Destiny stats and access endpoints from their REST API☆12Nov 12, 2015Updated 10 years ago
- hammal is a framework in which you can extract data from different data sources to different data destinations☆11Nov 1, 2014Updated 11 years ago
- A table schema-less OLAP Analytics Engine for Big Data.☆24Apr 23, 2024Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- A distributed data integration framework that simplifies common aspects of big data integration such as data ingestion, replication, orga…☆2,261Updated this week
- Capture the logical plan from Spark (SQL)☆22Mar 6, 2021Updated 5 years ago
- Parse Redis dump.rdb file☆31Aug 30, 2016Updated 9 years ago
- Helper for consuming Divolte events from Kafka queues and deserializing Avro records into Java objects using Avro's generated code.☆15Nov 6, 2014Updated 11 years ago
- ☆32Jul 27, 2016Updated 9 years ago
- ☆11Aug 14, 2014Updated 11 years ago
- A faked htable implementation for testing of HBase applications☆31Sep 26, 2014Updated 11 years ago
- Maelstrom is an open source Kafka integration with Spark that is designed to be developer friendly, high performance (millisecond stream …☆22Feb 6, 2017Updated 9 years ago
- ☆21Mar 17, 2023Updated 3 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Another kafka-hadoop-consumer☆26Apr 17, 2013Updated 12 years ago
- THIS REPOSITORY IS DEPRECATED☆19Jul 6, 2023Updated 2 years ago
- flumeng-kafka-plugin☆76Aug 31, 2015Updated 10 years ago
- A netty-spring-based web controller framework.☆17Feb 16, 2016Updated 10 years ago
- 一个redis集群管理方案☆22Dec 10, 2022Updated 3 years ago
- The Kiji project suite☆33Jun 18, 2015Updated 10 years ago
- ☆39Jun 15, 2016Updated 9 years ago
- LASER-A Scalable Response Prediction Platform For Online Advertising☆48Sep 23, 2014Updated 11 years ago
- A Spark SQL HBase connector☆29May 4, 2015Updated 10 years ago
- DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Presto connector for Apache Kudu☆48Mar 22, 2019Updated 7 years ago
- An Apache Hive management system☆84Jul 21, 2015Updated 10 years ago
- Apache Spark based ETL Engine☆71Oct 18, 2016Updated 9 years ago
- SQL for Kafka Connectors☆100Jan 9, 2024Updated 2 years ago
- Helpful user defined fuctions / table generating functions for Hive☆102May 2, 2016Updated 9 years ago
- ☆20Jun 29, 2022Updated 3 years ago
- Advertising delivery engine based on SF1R☆16Sep 23, 2014Updated 11 years ago