Hadoop Job for schemaless incremental loading of messages from Kafka topics onto hdfs with configurable output partitioning.
☆91Oct 2, 2016Updated 9 years ago
Alternatives and similar repositories for kafka-hadoop-loader
Users that are interested in kafka-hadoop-loader are comparing it to the libraries listed below
Sorting:
- A High Performance Cluster Consumer for Kafka that creates Avro (boom) files in Hadoop in time based directory paths☆42Jun 3, 2016Updated 9 years ago
- kafka0.8.2 using simple consumer load message into hdfs using custom mapreduce☆12Aug 12, 2015Updated 10 years ago
- Java client to connect directly to Impala using thrift☆33Apr 12, 2017Updated 8 years ago
- Maven plugin for Scalastyle☆23Apr 11, 2023Updated 2 years ago
- Another kafka-hadoop-consumer☆26Apr 17, 2013Updated 12 years ago
- 使用kafka实现log4j日志集中管理☆14Jan 6, 2021Updated 5 years ago
- 一个为spark批量导入数据到hbase的库☆42Nov 18, 2016Updated 9 years ago
- Library of different Bloom filters in Java with optional Redis-backing, counting and many hashing options.☆20Aug 21, 2022Updated 3 years ago
- Capture the logical plan from Spark (SQL)☆22Mar 6, 2021Updated 5 years ago
- A table schema-less OLAP Analytics Engine for Big Data.☆24Apr 23, 2024Updated last year
- LinkedIn's previous generation Kafka to HDFS pipeline.☆884Aug 27, 2020Updated 5 years ago
- A netty-spring-based web controller framework.☆17Feb 16, 2016Updated 10 years ago
- storm kafka hdfs examples☆21Nov 28, 2016Updated 9 years ago
- An open source enterprise data warehousing and analysis platform.☆22Nov 8, 2021Updated 4 years ago
- Kafka as Hive Storage☆65Nov 13, 2014Updated 11 years ago
- SQL for Kafka Connectors☆101Jan 9, 2024Updated 2 years ago
- A distributed data integration framework that simplifies common aspects of big data integration such as data ingestion, replication, orga…☆2,261Feb 27, 2026Updated last week
- Presto connector for Apache Kudu☆48Mar 22, 2019Updated 6 years ago
- cli app to create JSON objects☆25Mar 3, 2022Updated 4 years ago
- Project demonstrating a Request and Response between two Actors with Kamon.io enabled.☆69Oct 6, 2014Updated 11 years ago
- assembly-examples☆26Jun 16, 2024Updated last year
- Low level integration of Spark and Kafka☆130Mar 15, 2018Updated 7 years ago
- flumeng-kafka-plugin☆77Aug 31, 2015Updated 10 years ago
- A Spark SQL HBase connector☆29May 4, 2015Updated 10 years ago
- Spark package to "plug" holes in data using SQL based rules ⚡️ 🔌☆29May 15, 2020Updated 5 years ago
- spring-boot利用scala写spark程序骨架☆28Oct 22, 2019Updated 6 years ago
- Kafka-Connect SMT (Single Message Transformations) with SQL syntax (Using Apache Calcite for the SQL parsing)☆33Apr 16, 2020Updated 5 years ago
- send mongo oplog stream to kafka☆29Sep 1, 2015Updated 10 years ago
- Yet Another Spark SQL JDBC/ODBC server based on the PostgreSQL V3 protocol☆34Sep 8, 2022Updated 3 years ago
- The Kiji project suite☆33Jun 18, 2015Updated 10 years ago
- Apache Spark based ETL Engine☆71Oct 18, 2016Updated 9 years ago
- Connect Spark to HBase for reading and writing data with ease☆295Dec 19, 2017Updated 8 years ago
- LASER-A Scalable Response Prediction Platform For Online Advertising☆48Sep 23, 2014Updated 11 years ago
- Data self exporting and monitoring platform based on Hive data warehouse. https://hc.smartloli.org☆36Jul 28, 2017Updated 8 years ago
- Second generation of the ICGC DCC release ETL built on Spark☆10Apr 8, 2019Updated 6 years ago
- A timer module for Redis☆11Oct 16, 2019Updated 6 years ago
- ☆20Jun 29, 2022Updated 3 years ago
- Integration of Iceberg table management into Spark SQL☆11Jan 21, 2020Updated 6 years ago
- 卸载拼夕夕☆12Jan 12, 2021Updated 5 years ago