elevy30 / bigdata-playground
POC for all the stack of big data (kafka, spark, cassandra, hdfs, docker, springboot)
☆12Updated 2 years ago
Alternatives and similar repositories for bigdata-playground
Users that are interested in bigdata-playground are comparing it to the libraries listed below
Sorting:
- 【易车】- Spark、flink、HBase、Hive、flume集成了一些Hadoop的原生api的一些demo(如HDFS、MapReduce:目前就这两个);同时测试一些异常功能☆16Updated 6 years ago
- ☆14Updated 8 years ago
- 使用spark streaming 导入kafka数据到hbase☆25Updated 9 years ago
- spark流数据处理,可以从flume-ng,kafka接收数据☆11Updated 9 years ago
- Streaming 相关项目☆15Updated 8 years ago
- spring+spark streaming+kafka 10版本集成和异常问题处理☆17Updated 7 years ago
- 用户画像代码,根据算法推算出用户的性别和年龄比率☆11Updated 7 years ago
- 基于 spark 混合查询平台,支持不同源数据库的联合查询,mysql hive presto ...☆14Updated 7 years ago
- Spark1.6和spark2.2的示例,包含kafka,flume,structuredstreaming,jedis,elasticsearch,mysql,dataframe☆15Updated 7 years ago
- Encapsulated spark 与其他组件的结合api,方便使用,例如 es,hbase,kudu,kafka,mq等☆35Updated 5 years ago
- 一个为spark批量导入数据到hbase的库☆43Updated 8 years ago
- Flink Sql 教程☆34Updated 5 months ago
- Spark structured-streaming 消费kafka数据写入hbase☆33Updated 6 years ago
- 易观开源大数据互联网百亿级记录互传Backquarter项目☆19Updated 2 years ago
- A HBase datasource implementation for Spark and [MLSQL](http://www.mlsql.tech).☆14Updated last year
- Data self exporting and monitoring platform based on Hive data warehouse. https://hc.smartloli.org☆36Updated 7 years ago
- flink rest api的spring-boot-starter☆17Updated last year
- 解析Mysql binlog日志并发至Kafka☆23Updated 8 years ago
- 因现有的datax、sqoop满足不了需求,使用spark封装了一个数据同步工具。☆9Updated 6 years ago
- Apache Flink自述理解与代码☆13Updated 6 years ago
- 记录Spark、Flink研究经验☆26Updated 5 years ago
- 此工程采用SpringBoot + Mybatis + SparkSQL + Hive框架进行集成,支持Kerberos认证。☆22Updated 7 years ago
- hadoop flume hbase kafka storm;读取kafka数据=》storm实时处理(分割字符,统计字符)=》写入hdfs☆21Updated 6 years ago
- 基于Yarn的容器调度引擎(container scheduler based on yarn)☆36Updated 9 years ago
- 可以说近几年Spark 的流行带动了Scala的发展,它集成了面向对象编程和函数式编程的各种特性,Scala具有更纯Lambda表粹的函数式业务逻辑解决方案,其语法比Java8后Lambda更加简洁方便,SpringBoot为Spring提供了一种更加方便快捷的方式,不再要求…☆61Updated 7 years ago
- 杭州第六次 Spark & Flink Meetup☆30Updated 7 years ago
- 执行Flink SQL 文件的客户端☆25Updated 3 years ago
- 优化flink的多流操作(例如join),优化点不限于数据丢失问题,以及性能问题☆11Updated 6 years ago
- 基于canal.deployer-1.1.1-SNAPSHOT.tar,canal连接kafka,springboot消费kafka数据入hbase和ElasticSearch☆14Updated 6 years ago
- 通过HBase Observer同步数据到ElasticSearch☆55Updated 10 years ago