juliopez / Hadoop
Infraestructura para Big Data : Hadoop + NiFi +Spark + Hive usando Docker
☆19Updated 2 years ago
Alternatives and similar repositories for Hadoop
Users that are interested in Hadoop are comparing it to the libraries listed below
Sorting:
- Zeppelin docker☆15Updated 4 years ago
- Creation of a data lakehouse and an ELT pipeline to enable the efficient analysis and use of data☆46Updated last year
- Dockerizing an Apache Spark Standalone Cluster☆43Updated 2 years ago
- Finance 🏦 Data Builder 🛠️ @ postgres 🐘☆21Updated 4 years ago
- Big Data Docker Data Science Spark Spark3 Hadoop HDFS Scala Python Artificial Intelligence Machine Learning Jupyter Lab Notebook☆16Updated this week
- The demo of using Kafka, Spark, Hive, Cassandra, etc by using Docker. It produces the production ready environment for any kinds of big d…☆33Updated 5 years ago
- Slowly Changing Dimension type 2 using Hive query language using exclusive join technique with ORC Hive tables, partitioned and clustered…☆16Updated 6 years ago
- Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…☆55Updated 2 years ago
- A docker using the airflow with Hadoop ecosystem (hive, spark, and sqoop)☆11Updated 4 years ago
- Infrastructure automation to deploy Hadoop,Hive,Spark,airflow nodes on a docker host☆20Updated 6 years ago
- A collection of data engineering projects: data modeling, ETL pipelines, data lakes, infrastructure configuration on AWS, data warehousin…☆15Updated 4 years ago
- Developed an ETL pipeline for a Data Lake that extracts data from S3, processes the data using Spark, and loads the data back into S3 as …☆16Updated 5 years ago
- Apche Spark Structured Streaming with Kafka using Python(PySpark)☆40Updated 6 years ago
- apache-nifi-templates☆51Updated 4 years ago
- Design/Implement stream/batch architecture on NYC taxi data | #DE☆25Updated 4 years ago
- Hadoop, Hive, Parquet and Hue in docker-compose v3☆42Updated 5 years ago
- End-to-end Kafka Streaming Examples on Databricks with Evolving Avro Schemas.☆9Updated last year
- 🚨 Simple, self-contained fraud detection system built with Apache Kafka and Python☆86Updated 6 years ago
- Just a boilerplate for PySpark and Flask☆35Updated 6 years ago
- ☆24Updated 3 years ago
- A ready to go Big Data cluster (Hadoop + Hadoop Streaming + Spark + PySpark) with Docker and Docker Swarm!☆20Updated 2 weeks ago
- This is a GitHub for all of my NiFi Templates☆46Updated 4 years ago
- Hadoop-Hive-Spark cluster + Jupyter on Docker☆74Updated 4 months ago
- CICD pipeline that deploys a dbt image on a GKE cluster☆11Updated 3 years ago
- Deploy your Spark Production Cluster on Kubernetes☆47Updated 4 years ago
- One click deploy docker-compose with Kafka, Spark Streaming, Zeppelin UI and Monitoring (Grafana + Kafka Manager)☆120Updated 3 years ago
- Lecture: Big Data☆15Updated 6 months ago
- Docker Airflow - Contains a docker compose file for Airflow 2.0☆65Updated 2 years ago
- This is my Apache Airflow Local development setup on Windows 10 WSL2/Mac using docker-compose. It will also include some sample DAGs and …☆29Updated last year
- Data lake, data warehouse on GCP☆56Updated 3 years ago