elevy30 / bigdata-playground
POC for all the stack of big data (kafka, spark, cassandra, hdfs, docker, springboot)
☆12Updated last year
Related projects: ⓘ
- 【易车】- Spark、flink、HBase、Hive、flume集成了一些Hadoop的原生api的一些demo（如HDFS、MapReduce：目前就这两个）；同时测试一些异常功能☆16Updated 5 years ago
- A HBase datasource implementation for Spark and [MLSQL](http://www.mlsql.tech).☆13Updated 11 months ago
- spark流数据处理，可以从flume-ng，kafka接收数据☆11Updated 9 years ago
- ☆14Updated 7 years ago
- ☆24Updated this week
- spring+spark streaming+kafka 10版本集成和异常问题处理☆18Updated 7 years ago
- ☆18Updated this week
- Spark1.6和spark2.2的示例，包含kafka,flume,structuredstreaming,jedis,elasticsearch,mysql,dataframe☆15Updated 6 years ago
- 使用spark对hive、hbase、ES的读写， 实现一次配置可对不同数据库进行导入导出，并对ES、hbase进行封装☆32Updated 7 years ago
- 使用spark streaming 导入kafka数据到hbase☆25Updated 8 years ago
- 用户画像代码，根据算法推算出用户的性别和年龄比率☆11Updated 6 years ago
- Streaming 相关项目☆15Updated 7 years ago
- flink rest api的spring-boot-starter☆17Updated last year
- Define and schedule workflow, support Flink Jar/SQL, ClickHouse/Hive/Mysql SQL, Shell, etc.☆16Updated last week
- 大数据组件学习；包括dataflow，spring cloud stream；elasticsearch；flink；spark；kafka；phoenix；Hive；Hbase；☆21Updated 2 years ago
- phoenix 操作hbase和springboot的整合☆11Updated 6 years ago
- 因现有的datax、sqoop满足不了需求，使用spark封装了一个数据同步工具。☆9Updated 5 years ago
- This project compose of two parts: 1) write, spark job to write to hbase using bulk load to; 2)read, rest api reading from hbase base on …☆20Updated 6 years ago
- 一个为spark批量导入数据到hbase的库☆43Updated 7 years ago
- ☆20Updated this week
- Streaming using Flink to connect Kafka and Elasticsearch☆29Updated 8 years ago
- 基于 spark 混合查询平台，支持不同源数据库的联合查询，mysql hive presto ...☆14Updated 7 years ago
- 基于 Spark Netty Rpc 框架，重新实现的一个 Netty Rpc 框架 ( scala + java )☆9Updated last year
- Encapsulated spark 与其他组件的结合api，方便使用，例如 es，hbase，kudu，kafka，mq等☆35Updated 4 years ago
- 对HBase API的简单封装，Java和Scala混编☆8Updated 7 years ago
- IoT Trucking App with Flink (with Table API & SQL)☆15Updated 6 years ago
- flink sql☆11Updated 2 years ago
- ☆70Updated this week
- Custom Spark Kafka consumer based on Kafka SimpleConsumer API.☆22Updated 9 years ago
- hadoop flume hbase kafka storm；读取kafka数据=》storm实时处理（分割字符，统计字符）=》写入hdfs☆21Updated 6 years ago