LiuGuH / kafka-hadoop-loader-my
kafka0.8.2 using simple consumer load message into hdfs using custom mapreduce
☆12Updated 9 years ago
Alternatives and similar repositories for kafka-hadoop-loader-my:
Users that are interested in kafka-hadoop-loader-my are comparing it to the libraries listed below
- Examples for Spark Training in chinahadoop.cn☆139Updated 7 years ago
- spark example code, has some production practice.☆175Updated 8 years ago
- DirectKafka examples for Spark Streaming : 1. with checkpointing 2. Custom offset management☆60Updated 8 years ago
- Spark源代码中文注释☆42Updated 6 years ago
- spark实例代码☆78Updated 7 years ago
- Spark源码剖析☆87Updated 7 years ago
- Deep Dive into Apache Spark 深入研读Spark源码☆261Updated 8 years ago
- SparkStreaming中利用MySQL保存Kafka偏移量保证0数据丢失☆45Updated 7 years ago
- a tool help copy files from hdfs direct to ftp server☆12Updated 2 years ago
- ☆131Updated 6 years ago
- Native, optimized access to HBase Data through Spark SQL/Dataframe Interfaces☆320Updated 3 years ago
- spark-scala-maven☆58Updated 6 years ago
- Spark2.4.0 学习笔记分享☆200Updated 6 years ago
- 一个手动管理spark streaming集成kafka时的偏移量到zookeeper中的小项目☆134Updated 3 weeks ago
- Some useful custom hive udf functions, especial array, json, math, string functions.☆225Updated 9 months ago
- ☆15Updated 8 years ago
- My Blog☆76Updated 7 years ago
- spark summit 2017 SanFrancisco☆97Updated 7 years ago
- Kafka delivery semantics in the case of failure depend on how and when offsets are stored. Spark output operations are at-least-once. So …☆37Updated 8 years ago
- ☆133Updated 7 years ago
- spark性能调优总结 spark config and tuning☆122Updated 7 years ago
- 封装sparkstreaming动态调节batch time(有数据就执行计算); 支持运行过程中增删topic; 封装sparkstreaming 1.6 - kafka 010 用以支持 SSL。☆180Updated 4 years ago
- ☆76Updated 11 years ago
- Hadoop Job for schemaless incremental loading of messages from Kafka topics onto hdfs with configurable output partitioning.☆89Updated 8 years ago
- ☆235Updated 2 years ago
- Spark Streaming监控平台,支持任务部署与告警、自启动☆128Updated 7 years ago
- High Performance Spark Streaming with Direct Kafka in Java☆39Updated 8 years ago
- ☆53Updated 7 years ago
- Apache Flink官方文档中文翻译计划☆488Updated 2 years ago
- ☆270Updated 6 years ago