alvertogit / bigdata_dockerLinks
Big Data Docker Data Science Spark Spark4 Hadoop HDFS Scala Python Artificial Intelligence Machine Learning Jupyter Lab Notebook
☆18Updated last week
Alternatives and similar repositories for bigdata_docker
Users that are interested in bigdata_docker are comparing it to the libraries listed below
Sorting:
- Dockerizing an Apache Spark Standalone Cluster☆43Updated 3 years ago
- Infraestructura para Big Data : Hadoop + NiFi +Spark + Hive usando Docker☆20Updated 2 years ago
- spark on kubernetes☆104Updated 2 years ago
- Multi docker container images for main Big Data Tools. (Hadoop, Spark, Kafka, HBase, Cassandra, Zookeeper, Zeppelin, Drill, Flink, Hive, …☆36Updated 10 months ago
- Docker Big Data Tools: This docker-compose file is configured to run multiple nodes. This is a Hadoop Cluster that contains the necessary…☆31Updated 4 years ago
- An Airflow docker image preconfigured to work well with Spark and Hadoop/EMR☆175Updated 5 months ago
- A bridge to Apache Atlas for provenance metadata created in course of using Apache NiFi☆15Updated 2 years ago
- Hadoop, Hive, Spark, Zeppelin and Livy: all in one Docker-compose file.☆169Updated 4 years ago
- The demo of using Kafka, Spark, Hive, Cassandra, etc by using Docker. It produces the production ready environment for any kinds of big d…☆37Updated 6 years ago
- Base Docker image with just essentials: Hadoop, Hive and Spark.☆70Updated 4 years ago
- One click deploy docker-compose with Kafka, Spark Streaming, Zeppelin UI and Monitoring (Grafana + Kafka Manager)☆120Updated 4 years ago
- Scalable CDC Pattern Implemented using PySpark☆18Updated 3 weeks ago
- Creation of a data lakehouse and an ELT pipeline to enable the efficient analysis and use of data☆48Updated last year
- Example for article Running Spark 3 with standalone Hive Metastore 3.0☆102Updated 2 years ago
- Capture the logical plan from Spark (SQL)☆22Updated 4 years ago
- A complete example of a big data application using : Kubernetes (kops/aws), Apache Spark SQL/Streaming/MLib, Apache Flink, Scala, Python,…☆209Updated 6 years ago
- Real-time Data Warehouse with Apache Flink & Apache Kafka & Apache Hudi☆117Updated last year
- Extract, Transform, Load (ETL) refers to a process in database usage and especially in data warehousing. This repository contains a s…☆21Updated 8 years ago
- Dockerfiles and Docker Compose for HDP 2.6 with Blueprints☆23Updated 7 years ago
- spark-drools tutorials☆16Updated last year
- Apache Spark examples exclusively in Java☆102Updated 2 years ago
- ☆50Updated 5 years ago
- An implementation of the DatasourceV2 interface of Apache Spark™ for writing Spark Datasets to Apache Druid™.☆43Updated 2 weeks ago
- Flowman is an ETL framework powered by Apache Spark. With its declarative approach, Flowman simplifies the development of complex data pi…☆96Updated last month
- Spark 3.0.0 Structured Streaming Kafka Avro Demo☆15Updated 2 years ago
- Real-world Spark pipelines examples☆83Updated 7 years ago
- Deploy your Spark Production Cluster on Kubernetes☆47Updated 5 years ago
- Delta Lake Examples☆12Updated 5 years ago
- A sample implementation of stream writes to an Iceberg table on GCS using Flink and reading it using Trino☆21Updated 3 years ago
- This is a real-time dashboard example using Spark Streaming and Node.js☆26Updated 8 years ago