alvertogit / bigdata_docker
Big Data Docker Data Science Spark Spark3 Hadoop HDFS Scala Python Artificial Intelligence Machine Learning Jupyter Lab Notebook
☆16Updated last week
Alternatives and similar repositories for bigdata_docker:
Users that are interested in bigdata_docker are comparing it to the libraries listed below
- Infrastructure automation to deploy Hadoop,Hive,Spark,airflow nodes on a docker host☆20Updated 6 years ago
- A curated list of awesome PrestoDB / Trino software, libraries, tools and resources☆17Updated 3 years ago
- Multi docker container images for main Big Data Tools. (Hadoop, Spark, Kafka, HBase, Cassandra, Zookeeper, Zeppelin, Drill, Flink, Hive, …☆34Updated 2 months ago
- Dockerizing an Apache Spark Standalone Cluster☆43Updated 2 years ago
- Hadoop-Hive-Spark cluster + Jupyter on Docker☆68Updated last month
- The demo of using Kafka, Spark, Hive, Cassandra, etc by using Docker. It produces the production ready environment for any kinds of big d…☆32Updated 5 years ago
- Run Hadoop Cluster within Docker Containers.☆16Updated last month
- Capture the logical plan from Spark (SQL)☆21Updated 3 years ago
- Scalable CDC Pattern Implemented using PySpark☆18Updated 5 years ago
- Apache-Spark based Data Flow(ETL) Framework which supports multiple read, write destinations of different types and also support multiple…☆26Updated 3 years ago
- A bridge to Apache Atlas for provenance metadata created in course of using Apache NiFi☆15Updated 2 years ago
- A sample implementation of stream writes to an Iceberg table on GCS using Flink and reading it using Trino☆19Updated 2 years ago
- Real-time Data Warehouse with Apache Flink & Apache Kafka & Apache Hudi☆112Updated last year
- Infraestructura para Big Data : Hadoop + NiFi +Spark + Hive usando Docker☆19Updated 2 years ago
- Transporter for integrating OpenLineage with OpenMetadata☆12Updated 11 months ago
- Eskimo is a state of the art Big Data Infrastructure and Management Web Console to build, manage and operate Big Data 2.0 Analytics clust…☆26Updated last year
- Creation of a data lakehouse and an ELT pipeline to enable the efficient analysis and use of data☆43Updated last year
- Example for article Running Spark 3 with standalone Hive Metastore 3.0☆97Updated 2 years ago
- Byzer VSCode Extension☆12Updated last year
- ☆14Updated 4 years ago
- Demo code for implementing and showcasing a Fraud Detection Engine with Apache Flink.☆31Updated 2 years ago
- ☆13Updated 6 years ago
- spark-drools tutorials☆16Updated 10 months ago
- Dockerized Hadoop/Minio/Hive/Presto stack☆36Updated 11 months ago
- Various Demos mostly based on docker environments☆34Updated 2 years ago
- The Internals of PySpark☆25Updated last month
- Extract, Transform, Load (ETL) refers to a process in database usage and especially in data warehousing. This repository contains a s…☆21Updated 7 years ago
- Nested Data (JSON/AVRO/XML) Parsing and Flattening in Spark☆16Updated last year
- Pipeline library for StreamSets Data Collector and Transformer☆33Updated 2 years ago
- Kafka, Spark Streaming, Kudu integration examples☆17Updated 7 years ago