Alternatives and similar repositories for spark-standalone-cluster:

Users that are interested in spark-standalone-cluster are comparing it to the libraries listed below

• mrn-aglic / pyspark-playground
  ☆75Updated 7 months ago
• cordon-thiago / airflow-spark
  Docker with Airflow and Spark standalone cluster
  ☆247Updated last year
• arezamoosavi / AcidOnSpark-ETL
  Delta-Lake, ETL, Spark, Airflow
  ☆45Updated 2 years ago
• josephmachado / beginner_de_project_stream
  Simple stream processing pipeline
  ☆94Updated 7 months ago
• josephmachado / spark_submit_airflow
  Simple repo to demonstrate how to submit a spark job to EMR from Airflow
  ☆32Updated 4 years ago
• delta-io / delta-examples
  Delta Lake examples
  ☆214Updated 3 months ago
• Armaan1Gohil / dataengineering-tech-stack
  Local Environment to Practice Data Engineering
  ☆112Updated 2 weeks ago
• josephmachado / online_store
  End to end data engineering project
  ☆53Updated 2 years ago
• josephmachado / data_engineering_best_practices
  Sample project to demonstrate data engineering best practices
  ☆174Updated 10 months ago
• josephmachado / data_engineering_project_template
  A template repository to create a data project with IAC, CI/CD, Data migrations, & testing
  ☆252Updated 6 months ago
• TJaniF / airflow-elt-blueprint
  A self-contained, ready to run Airflow ELT project. Can be run locally or within codespaces.
  ☆62Updated last year
• josephmachado / efficient_data_processing_spark
  Code for "Efficient Data Processing in Spark" Course
  ☆269Updated 3 months ago
• josephmachado / bitcoinMonitor
  Near real time ETL to populate a dashboard.
  ☆71Updated 7 months ago
• dsynkov / spark-livy-on-airflow-workspace
  A workspace to experiment with Apache Spark, Livy, and Airflow in a Docker environment.
  ☆39Updated 3 years ago
• dominikhei / Local-Data-LakeHouse
  Sample Data Lakehouse deployed in Docker containers using Apache Iceberg, Minio, Trino and a Hive Metastore. Can be used for local testin…
  ☆58Updated last year
• afaqueahmad7117 / spark-experiments
  Ultimate guide for mastering Spark Performance Tuning and Optimization concepts and for preparing for Data Engineering interviews
  ☆96Updated 7 months ago
• Snowflake-Labs / sfguide-data-engineering-with-snowpark-python
  ☆116Updated 3 months ago
• Nike-Inc / spark-expectations
  A Python Library to support running data quality rules while the spark job is running⚡
  ☆167Updated last week
• sdesilva26 / docker-spark
  Tutorial for setting up a Spark cluster running inside of Docker containers located on different machines
  ☆126Updated 2 years ago
• jamesshocking / Spark-REST-API-UDF
  Example of how to leverage Apache Spark distributed capabilities to call REST-API using a UDF
  ☆50Updated 2 years ago
• bartosz25 / data-engineering-design-patterns-book
  Code snippets for Data Engineering Design Patterns book
  ☆49Updated last week
• adidas / lakehouse-engine
  The Lakehouse Engine is a configuration driven Spark framework, written in Python, serving as a scalable and distributed engine for sever…
  ☆229Updated 2 months ago
• Data-Engineer-Camp / dbt-dimensional-modelling
  Step-by-step tutorial on building a Kimball dimensional model with dbt
  ☆118Updated 6 months ago
• josephmachado / simple_dbt_project
  Code for dbt tutorial
  ☆149Updated 7 months ago
• cluster-apps-on-docker / spark-standalone-cluster-on-docker
  Learn Apache Spark in Scala, Python (PySpark) and R (SparkR) by building your own cluster with a JupyterLab interface on Docker.
  ☆473Updated 2 years ago
• LearningJournal / Apache-Spark-and-Databricks-Stream-Processing-in-Lakehouse
  ☆44Updated last year
• pyjaime / docker-airflow-spark
  Docker with Airflow + Postgres + Spark cluster + JDK (spark-submit support) + Jupyter Notebooks
  ☆21Updated 2 years ago