Alternatives and similar repositories for spark-standalone-cluster

Users that are interested in spark-standalone-cluster are comparing it to the libraries listed below

• cordon-thiago / airflow-spark
  Docker with Airflow and Spark standalone cluster
  ☆261Updated 2 years ago
• josephmachado / simple_dbt_project
  Code for dbt tutorial
  ☆161Updated last week
• josephmachado / socialetl
  Project for "Data pipeline design patterns" blog.
  ☆45Updated last year
• josephmachado / data_engineering_best_practices
  Sample project to demonstrate data engineering best practices
  ☆196Updated last year
• josephmachado / beginner_de_project_stream
  Simple stream processing pipeline
  ☆108Updated last year
• Armaan1Gohil / dataengineering-tech-stack
  Local Environment to Practice Data Engineering
  ☆143Updated 8 months ago
• mrn-aglic / pyspark-playground
  ☆89Updated 7 months ago
• dominikhei / Local-Data-LakeHouse
  Sample Data Lakehouse deployed in Docker containers using Apache Iceberg, Minio, Trino and a Hive Metastore. Can be used for local testin…
  ☆74Updated 2 years ago
• kaoutaar / end-to-end-etl-pipeline-jcdecaux-API
  velib-v2: An ETL pipeline that employs batch and streaming jobs using Spark, Kafka, Airflow, and other tools, all orchestrated with Docke…
  ☆20Updated last month
• arezamoosavi / AcidOnSpark-ETL
  Delta-Lake, ETL, Spark, Airflow
  ☆48Updated 2 years ago
• josephmachado / data_engineering_project_template
  A template repository to create a data project with IAC, CI/CD, Data migrations, & testing
  ☆276Updated last year
• cluster-apps-on-docker / spark-standalone-cluster-on-docker
  Learn Apache Spark in Scala, Python (PySpark) and R (SparkR) by building your own cluster with a JupyterLab interface on Docker.
  ☆495Updated 2 years ago
• bartosz25 / data-engineering-design-patterns-book
  Code snippets for Data Engineering Design Patterns book
  ☆182Updated 5 months ago
• delta-io / delta-examples
  Delta Lake examples
  ☆227Updated 11 months ago
• josephmachado / efficient_data_processing_spark
  Code for "Efficient Data Processing in Spark" Course
  ☆338Updated 3 months ago
• pyjaime / docker-airflow-spark
  Docker with Airflow + Postgres + Spark cluster + JDK (spark-submit support) + Jupyter Notebooks
  ☆24Updated 3 years ago
• konosp / dbt-airflow-docker-compose
  Execution of DBT models using Apache Airflow through Docker Compose
  ☆118Updated 2 years ago
• josephmachado / bitcoinMonitor
  Near real time ETL to populate a dashboard.
  ☆72Updated last week
• dogukannulu / kafka_spark_structured_streaming
  Get data from API, run a scheduled script with Airflow, send data to Kafka and consume with Spark, then write to Cassandra
  ☆143Updated 2 years ago
• TJaniF / airflow-elt-blueprint
  A self-contained, ready to run Airflow ELT project. Can be run locally or within codespaces.
  ☆78Updated 2 years ago
• josephmachado / spark_submit_airflow
  Simple repo to demonstrate how to submit a spark job to EMR from Airflow
  ☆34Updated 4 years ago
• adidas / lakehouse-engine
  The Lakehouse Engine is a configuration driven Spark framework, written in Python, serving as a scalable and distributed engine for sever…
  ☆266Updated last week
• josephmachado / online_store
  End to end data engineering project
  ☆57Updated 2 years ago
• ongxuanhong / de02-pyspark-optimization
  ☆14Updated 2 years ago
• yTek01 / docker-spark-airflow
  ☆40Updated 2 years ago
• MrPowers / mack
  Delta Lake helper methods in PySpark
  ☆325Updated last year
• 1ambda / lakehouse
  Playground for Lakehouse (Iceberg, Hudi, Spark, Flink, Trino, DBT, Airflow, Kafka, Debezium CDC)
  ☆60Updated last year
• bruno-szdl / dbt-ci-cd
  ☆156Updated 3 weeks ago
• davidzajac1 / zillacode
  Open Source LeetCode for PySpark, Spark, Pandas and DBT/Snowflake
  ☆208Updated 2 months ago
• Amrit-Hub / Databricks-Certified-Data-Engineer-Professional-Questions
  This repo contains "Databricks Certified Data Engineer Professional" Questions and related docs.
  ☆109Updated last year