enkhalifapro / bigdata-all-in-one
Docker-compose contains the most common big data systems like: Apache Hadoop, Apache Hive, Apache Spark, Jupyter, Flink
☆27Updated last year
Alternatives and similar repositories for bigdata-all-in-one:
Users that are interested in bigdata-all-in-one are comparing it to the libraries listed below
- Hadoop-Hive-Spark cluster + Jupyter on Docker☆72Updated 3 months ago
- Infrastructure automation to deploy Hadoop,Hive,Spark,airflow nodes on a docker host☆20Updated 6 years ago
- Base Docker image with just essentials: Hadoop, Hive and Spark.☆68Updated 4 years ago
- Docker Big Data Tools: This docker-compose file is configured to run multiple nodes. This is a Hadoop Cluster that contains the necessary…☆29Updated 3 years ago
- 一键搭建zookeeper/hadoop/hive/hbase/sqoop/kafka/spark/kylin☆34Updated 5 years ago
- 基于SparkSQL的电影分析项目实战☆40Updated 4 years ago
- SparkStreaming项目,显示flume->Kafka->Spark->hbase(实时数据处理方案),Scala实现☆36Updated 7 years ago
- docker-hadoop-spark-hive 快速构建你的大数据环境☆21Updated 5 years ago
- spark自学手册,包含了例如spark core、spark sql、spark streaming、spark-kafka、delta-lake,以及scala基础练习,还有一些例如master、shuffle源码分析,总结及翻译。☆18Updated last year
- k8s hadoop,在k8s上快速搭建一个hadoop/hbase/hive环境,很早的项目自已用,腾讯tbds培训,以此为基础(多了一个kafka/flink)搭一套环境练习,又捡起来了☆22Updated 4 years ago
- Hadoop, Hive, Spark, Zeppelin and Livy: all in one Docker-compose file.☆164Updated 4 years ago
- spark将hdfs数据高性能灌入kafka,然后spark streaming/structured streaming高速消费,关注性能,欢迎提供性能/代码优化建议☆33Updated 6 years ago
- ☆29Updated 5 years ago
- 基于spark-ml,spark-mllib,spark-streaming的推荐算法实现☆96Updated 5 years ago
- 基于Spark2.2新闻网大数据实时系统项目☆61Updated 6 years ago
- Spark Streaming + kafka + hbase☆15Updated 6 years ago
- 数据治理->数据质量☆10Updated 5 years ago
- 四川大学拓思爱诺用户session行为数据离线分析项目☆67Updated 2 years ago
- 基于flink的用户行为分析☆51Updated last year
- A Hadoop cluster based on Docker, including Hive and Spark.☆79Updated 2 years ago
- Kafka, Spark Streaming, Kudu integration examples☆17Updated 7 years ago
- Spark 学习之路,包含 Spark Core,Spark SQL,Spark Streaming,Spark mllib 学习笔记☆146Updated 6 years ago
- 通过SparkLauncher使用springboot构建rest api远程提交spark任务,博客地址:https://blog.csdn.net/hlp4207/article/details/100831384☆45Updated 7 months ago
- 一个实时数仓项目,从0到1搭建实时数仓☆58Updated 3 years ago
- scala学习☆13Updated 5 years ago
- 简单易用的ETL工具☆17Updated 6 years ago
- spark算子使用例子, spark RDD的算子挺多,有时候如何灵活的使用,该如何用一下子想不起来,这一段时间将spark的算子如何使用的例子给记录了下来,下面是spark RDD 的一些常用算子的使用 这些算子包括有java的,也有scala的语言(博客中才有),由于精…☆36Updated 6 years ago
- 大数据框架 Spark MLlib 机器学习库基础算法全面讲解,附带齐全的测试文件☆39Updated last year
- Docker images for building hadoop3.2, hive 3.1, hbase2.3, presto 0.247, flink1.11.3 on yarn, etc.☆30Updated 2 years ago
- A scala maven project for user behavior analysis in eCommerce company with Flink.☆30Updated last year