edbullen / DockerSpark245

Related projects ⓘ

Alternatives and complementary repositories for DockerSpark245

• cordon-thiago / airflow-spark
  Docker with Airflow and Spark standalone cluster
  ☆246Updated last year
• rafaelvp-db / databricks-end-to-end-streaming
  End-to-end Kafka Streaming Examples on Databricks with Evolving Avro Schemas.
  ☆9Updated 8 months ago
• yTek01 / docker-spark-airflow
  ☆32Updated last year
• dsynkov / spark-livy-on-airflow-workspace
  A workspace to experiment with Apache Spark, Livy, and Airflow in a Docker environment.
  ☆39Updated 3 years ago
• sdesilva26 / docker-spark
  Tutorial for setting up a Spark cluster running inside of Docker containers located on different machines
  ☆123Updated 2 years ago
• arezamoosavi / AcidOnSpark-ETL
  Delta-Lake, ETL, Spark, Airflow
  ☆44Updated 2 years ago
• mrugankray / Big-Data-Cluster
  The goal of this project is to build a docker cluster that gives access to Hadoop, HDFS, Hive, PySpark, Sqoop, Airflow, Kafka, Flume, Pos…
  ☆55Updated last year
• martinkarlssonio / big-data-solution
  ☆43Updated last year
• pran4ajith / spark-twitter-streaming
  A real-time streaming ETL pipeline for streaming and performing sentiment analysis on Twitter data using Apache Kafka, Apache Spark and D…
  ☆29Updated 4 years ago
• cluster-apps-on-docker / spark-standalone-cluster-on-docker
  Learn Apache Spark in Scala, Python (PySpark) and R (SparkR) by building your own cluster with a JupyterLab interface on Docker.
  ☆463Updated last year
• dogukannulu / airflow_kafka_cassandra_mongodb
  Produce Kafka messages, consume them and upload into Cassandra, MongoDB.
  ☆37Updated last year
• Marcel-Jan / docker-hadoop-spark
  Multi-container environment with Hadoop, Spark and Hive
  ☆203Updated 10 months ago
• pyjaime / docker-airflow-spark
  Docker with Airflow + Postgres + Spark cluster + JDK (spark-submit support) + Jupyter Notebooks
  ☆21Updated 2 years ago
• Stefen-Taime / stream-ingestion-redpanda-minio
  In this article, you will learn how to set up a real-time data processing and analytics environment using Docker, MySQL, Redpanda, MinIO,…
  ☆10Updated last year
• delta-io / delta-examples
  Delta Lake examples
  ☆208Updated last month
• dogukannulu / streaming_data_processing
  Create a streaming data, transfer it to Kafka, modify it with PySpark, take it to ElasticSearch and MinIO
  ☆57Updated last year
• josephmachado / spark_submit_airflow
  Simple repo to demonstrate how to submit a spark job to EMR from Airflow
  ☆32Updated 4 years ago
• ryanchynoweth44 / DatabricksContent
  Examples surrounding Databricks.
  ☆56Updated 4 months ago
• vivek-bombatkar / Spark-with-Python---My-learning-notes-
  ETL pipeline using pyspark (Spark - Python)
  ☆108Updated 4 years ago
• Realsid / databricks-spark-certification
  Guide for databricks spark certification
  ☆58Updated 3 years ago
• itversity / data-engineering-spark
  ☆86Updated 2 years ago
• LearningJournal / Spark-Streaming-In-Python
  Apache Spark 3 - Structured Streaming Course Material
  ☆119Updated last year
• JesusAcuna / data-engineering-project
  ☆27Updated last year
• juliopez / Hadoop
  Infraestructura para Big Data : Hadoop + NiFi +Spark + Hive usando Docker
  ☆19Updated last year
• mrn-aglic / spark-standalone-cluster
  This repo contains a spark standalone cluster on docker for anyone who wants to play with PySpark by submitting their applications.
  ☆23Updated last year
• msemn / bd-infra
  ☆90Updated 2 years ago
• axel-sirota / productionalizing-data-pipelines-airflow
  Productionalizing Data Pipelines with Apache Airflow
  ☆111Updated 2 years ago
• jonathanneo / databricks-unit-testing
  Unit testing using databricks connect
  ☆30Updated 3 years ago
• derar-alhussein / Databricks-Certified-Data-Engineer-Professional
  The resources of the preparation course for Databricks Data Engineer Professional certification exam
  ☆86Updated last month