Gschiavon / Kafka-SparkStreaming-HDFSView external linksLinks
☆14Nov 3, 2016Updated 9 years ago
Alternatives and similar repositories for Kafka-SparkStreaming-HDFS
Users that are interested in Kafka-SparkStreaming-HDFS are comparing it to the libraries listed below
Sorting:
- Streaming 相关项目☆15Mar 27, 2017Updated 8 years ago
- Spark Streaming HBase Example☆22Mar 16, 2016Updated 9 years ago
- ☆12May 11, 2016Updated 9 years ago
- 使用spark streaming 导入kafka数据到hbase☆25Apr 14, 2016Updated 9 years ago
- spark流数据处理,可以从flume-ng,kafka接收数据☆11Sep 16, 2015Updated 10 years ago
- Apache-kafka-spark-streaming-poc☆10Mar 19, 2017Updated 8 years ago
- Spark Streaming example project which pulls messages from Kafka and write to HBase Table.☆11Jul 5, 2015Updated 10 years ago
- Spark structured-streaming 消费kafka数据写入hbase☆33Jan 22, 2019Updated 7 years ago
- 基于jsqlparser 进行sql语句解析,得到字段间的血缘关系(即所查询字段来源于哪张表中的哪个字段)☆19Oct 6, 2023Updated 2 years ago
- Kafka delivery semantics in the case of failure depend on how and when offsets are stored. Spark output operations are at-least-once. So …☆37Apr 19, 2017Updated 8 years ago
- An example project that combines Spark Streaming, Kafka, and Parquet to transform JSON objects streamed over Kafka into Parquet files in …☆19Jun 22, 2021Updated 4 years ago
- DirectKafka examples for Spark Streaming : 1. with checkpointing 2. Custom offset management☆60Sep 9, 2016Updated 9 years ago
- conbine flume,spark-streaming and redis for real-time computing☆22Oct 20, 2014Updated 11 years ago
- SparkStreaming中利用MySQL保存Kafka偏移量保证0数据丢失☆44Aug 2, 2017Updated 8 years ago
- PySpark-ETL☆22Dec 16, 2019Updated 6 years ago
- Using Spark SQLContext, HiveContext & Spark DataFrames API with ElasticSearch, Cassandra & MongoDB☆22Sep 13, 2016Updated 9 years ago
- Flume-to-Spark-Streaming Log Parser☆23Jun 3, 2016Updated 9 years ago
- Use Scala API to read/write data from different databases,HBase,MySQL,etc.☆24Feb 28, 2018Updated 7 years ago
- spark将hdfs数据高性能灌入kafka,然后spark streaming/structured streaming高速消费,关注性能,欢迎提供性能/代码优化建议☆33Mar 24, 2019Updated 6 years ago
- A Spark SQL HBase connector☆29May 4, 2015Updated 10 years ago
- ☆12Feb 22, 2023Updated 2 years ago
- Learning Flink : Flink CEP,Flink Core,Flink SQL☆73Feb 21, 2022Updated 3 years ago
- 自助搭建的 hadoop + spark + kafka + zookeeper + storm + hbase + hive + flume 集群,一主两从。☆31Jan 16, 2019Updated 7 years ago
- ☆16Apr 8, 2018Updated 7 years ago
- ☆13Jun 28, 2021Updated 4 years ago
- Learning PySpark video series☆11Mar 5, 2018Updated 7 years ago
- Includes several examples of data manipulation techniques by using PySpark and machine learning algorithms using MLib☆10Jun 14, 2021Updated 4 years ago
- 基于FastAPI + LangChain + OpenAI API + Vue的AI表格处理工具,用于智能化处理和分析表格数据。☆17Jul 14, 2025Updated 7 months ago
- json或SQL语言转为flink或者spark流/批任务☆12Jun 21, 2022Updated 3 years ago
- ☆10Feb 12, 2020Updated 6 years ago
- hadoop中Map/Reduce使用示例,输入(DBInputFormat),输出(DBOutputFormat)为MySql数据库表、日志分析Grep、单词排序Sort...对HBase的基本操作,增、删、查、改,使用Map/Reduce批量导入数据到HBase表中..…☆14Apr 6, 2013Updated 12 years ago
- Drawbridge is a lightweight API gateway written in Go☆12Apr 18, 2020Updated 5 years ago
- Code repository for tutorial sample code, solutions and demos hosted on AIandGames.com☆10Sep 20, 2017Updated 8 years ago
- 请求spark rest API获取applications,jobs,stages,executors,rdds,streaming,environment等信息提供监控和报警服务☆11Nov 22, 2018Updated 7 years ago
- ☆11Jan 14, 2024Updated 2 years ago
- Lamda code written in python☆14Oct 22, 2022Updated 3 years ago
- Kubenetes with SpringBoot demo☆10Feb 20, 2019Updated 6 years ago
- 大数据实习hdfs+flume+kafka+spark+hbase+hive项目☆35Jul 25, 2017Updated 8 years ago
- ☆38Aug 19, 2015Updated 10 years ago