Alternatives and similar repositories for spark-standalone-cluster-on-docker:

Users that are interested in spark-standalone-cluster-on-docker are comparing it to the libraries listed below

• cordon-thiago / airflow-spark
  Docker with Airflow and Spark standalone cluster
  ☆249Updated last year
• sdesilva26 / docker-spark
  Tutorial for setting up a Spark cluster running inside of Docker containers located on different machines
  ☆128Updated 2 years ago
• mvillarrealb / docker-spark-cluster
  A simple spark standalone cluster for your testing environment purposses
  ☆566Updated 11 months ago
• dsynkov / spark-livy-on-airflow-workspace
  A workspace to experiment with Apache Spark, Livy, and Airflow in a Docker environment.
  ☆39Updated 3 years ago
• bitsondatadev / trino-getting-started
  ☆258Updated 3 months ago
• delta-io / delta-examples
  Delta Lake examples
  ☆217Updated 4 months ago
• myamafuj / hadoop-hive-spark-docker
  Hadoop-Hive-Spark cluster + Jupyter on Docker
  ☆68Updated last month
• josephmachado / spark_submit_airflow
  Simple repo to demonstrate how to submit a spark job to EMR from Airflow
  ☆32Updated 4 years ago
• mrugankray / Big-Data-Cluster
  The goal of this project is to build a docker cluster that gives access to Hadoop, HDFS, Hive, PySpark, Sqoop, Airflow, Kafka, Flume, Pos…
  ☆58Updated last year
• mrn-aglic / spark-standalone-cluster
  This repo contains a spark standalone cluster on docker for anyone who wants to play with PySpark by submitting their applications.
  ☆30Updated last year
• MrPowers / chispa
  PySpark test helper methods with beautiful error messages
  ☆663Updated last month
• Marcel-Jan / docker-hadoop-spark
  Multi-container environment with Hadoop, Spark and Hive
  ☆205Updated last year
• LearningJournal / Spark-Streaming-In-Python
  Apache Spark 3 - Structured Streaming Course Material
  ☆121Updated last year
• cartershanklin / pyspark-cheatsheet
  PySpark Cheat Sheet - example code to help you learn PySpark and develop apps faster
  ☆441Updated 4 months ago
• GoogleCloudDataproc / spark-bigquery-connector
  BigQuery data source for Apache Spark: Read data from BigQuery into DataFrames, write DataFrames into BigQuery tables.
  ☆386Updated last week
• spark-examples / spark-scala-examples
  This project provides Apache Spark SQL, RDD, DataFrame and Dataset examples in Scala language
  ☆561Updated 11 months ago
• acryldata / datahub-helm
  Repository of helm charts for deploying DataHub on a Kubernetes cluster
  ☆173Updated last week
• MrPowers / mack
  Delta Lake helper methods in PySpark
  ☆315Updated 5 months ago
• BasPH / data-pipelines-with-apache-airflow
  Code for Data Pipelines with Apache Airflow
  ☆751Updated 6 months ago
• arezamoosavi / AcidOnSpark-ETL
  Delta-Lake, ETL, Spark, Airflow
  ☆46Updated 2 years ago
• YotpoLtd / metorikku
  A simplified, lightweight ETL Framework based on Apache Spark
  ☆586Updated last year
• 1ambda / lakehouse
  Playground for Lakehouse (Iceberg, Hudi, Spark, Flink, Trino, DBT, Airflow, Kafka, Debezium CDC)
  ☆50Updated last year
• spark-examples / pyspark-examples
  Pyspark RDD, DataFrame and Dataset Examples in Python language
  ☆1,222Updated 10 months ago
• mrpowers-io / quinn
  pyspark methods to enhance developer productivity 📣 👯 🎉
  ☆661Updated 2 months ago
• tuanavu / airflow-tutorial
  Apache Airflow tutorial
  ☆940Updated 2 years ago
• tiagotxm / yt-spark-no-kubernetes
  ☆10Updated this week
• greatexpectationslabs / ge_tutorials
  Learn how to add data validation and documentation to a data pipeline built with dbt and Airflow.
  ☆166Updated last year
• dbt-labs / dbt-spark
  dbt-spark contains all of the code enabling dbt to work with Apache Spark and Databricks
  ☆419Updated last week
• astronomer / airflow-guides
  Guides and docs to help you get up and running with Apache Airflow.
  ☆805Updated 2 years ago
• josephmachado / data_engineering_project_template
  A template repository to create a data project with IAC, CI/CD, Data migrations, & testing
  ☆256Updated 7 months ago