juliopez / HadoopLinks
Infraestructura para Big Data : Hadoop + NiFi +Spark + Hive usando Docker
☆20Updated 3 weeks ago
Alternatives and similar repositories for Hadoop
Users that are interested in Hadoop are comparing it to the libraries listed below
Sorting:
- Creation of a data lakehouse and an ELT pipeline to enable the efficient analysis and use of data☆49Updated 2 years ago
- Dockerizing an Apache Spark Standalone Cluster☆42Updated 3 years ago
- Zeppelin docker☆16Updated 5 years ago
- Hadoop, Hive, Parquet and Hue in docker-compose v3☆42Updated 5 years ago
- One click deploy docker-compose with Kafka, Spark Streaming, Zeppelin UI and Monitoring (Grafana + Kafka Manager)☆120Updated 4 years ago
- The demo of using Kafka, Spark, Hive, Cassandra, etc by using Docker. It produces the production ready environment for any kinds of big d…☆37Updated 6 years ago
- ☆46Updated 2 years ago
- Big Data Docker Data Science Spark Spark4 Hadoop HDFS Scala Python Artificial Intelligence Machine Learning Jupyter Lab Notebook☆19Updated last week
- Lecture: Big Data☆15Updated 3 months ago
- Apche Spark Structured Streaming with Kafka using Python(PySpark)☆40Updated 6 years ago
- Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…☆56Updated 2 years ago
- A docker using the airflow with Hadoop ecosystem (hive, spark, and sqoop)☆13Updated 4 years ago
- A consumer of a Kafka topic based on Flink☆12Updated 3 years ago
- Docker Big Data Tools: This docker-compose file is configured to run multiple nodes. This is a Hadoop Cluster that contains the necessary…☆31Updated 4 years ago
- ☆24Updated 4 years ago
- Set up a 3 node spark cluster using docker containers☆34Updated 7 years ago
- Hadoop-Hive-Spark cluster + Jupyter on Docker☆83Updated last year
- Spark, Airflow, Kafka☆24Updated 2 years ago
- Spark + Jupyer + Hive☆16Updated 10 years ago
- Apache Spark Course Material☆96Updated 2 years ago
- Developed an ETL pipeline for a Data Lake that extracts data from S3, processes the data using Spark, and loads the data back into S3 as …☆16Updated 6 years ago
- Finance 🏦 Data Builder 🛠️ @ postgres 🐘☆23Updated 4 years ago
- The Python fake data producer for Apache Kafka® is a complete demo app allowing you to quickly produce JSON fake streaming datasets and …☆84Updated last year
- An Airflow docker image preconfigured to work well with Spark and Hadoop/EMR☆175Updated 8 months ago
- Multi-container environment with Hadoop, Spark and Hive☆230Updated 8 months ago
- Spark and Hive docker containers sharing a common MySQL metastore☆26Updated 5 years ago
- Docker with hadoop spark pig hive☆26Updated 6 years ago
- Real-Time Data Processing Pipeline & Visualization with Docker, Spark, Kafka and Cassandra☆85Updated 8 years ago
- This project demonstrates how to build and automate an ETL pipeline using DAGs in Airflow and load the transformed data to Bigquery. Ther…☆24Updated 5 months ago
- python script examples in NiFi☆68Updated 5 years ago