Alternatives and similar repositories for apache-spark-docker

Users that are interested in apache-spark-docker are comparing it to the libraries listed below

• vim89 / datapipelines-essentials-python
  Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…
  ☆55Updated 2 years ago
• sankamuk / PysparkCheatsheet
  PySpark Cheatsheet
  ☆36Updated 2 years ago
• arezamoosavi / AcidOnSpark-ETL
  Delta-Lake, ETL, Spark, Airflow
  ☆47Updated 2 years ago
• NeerajBhadani / spark-streaming
  This repository contains code for Spark Streaming
  ☆22Updated 4 years ago
• PacktPublishing / Data-Engineering-with-Apache-Spark-Delta-Lake-and-Lakehouse
  Data Engineering with Spark and Delta Lake
  ☆101Updated 2 years ago
• vivek-bombatkar / Spark-with-Python---My-learning-notes-
  ETL pipeline using pyspark (Spark - Python)
  ☆117Updated 5 years ago
• saikrishnapujari / Spark-Nested-Data-Parser
  Nested Data (JSON/AVRO/XML) Parsing and Flattening in Spark
  ☆16Updated last year
• Wittline / pyspark-on-aws-emr
  The goal of this project is to offer an AWS EMR template using Spot Fleet and On-Demand Instances that you can use quickly. Just focus on…
  ☆27Updated 3 years ago
• TomLous / medium-spark-k8s
  Spark on Kubernetes using Helm
  ☆34Updated 5 years ago
• bartosz25 / spark-playground
  Code snippets used in demos recorded for the blog.
  ☆37Updated last week
• shravan-kuchkula / udacity-data-eng-proj-1
  Developed a data pipeline to automate data warehouse ETL by building custom airflow operators that handle the extraction, transformation,…
  ☆90Updated 3 years ago
• ankurchavda / data-engineering-zoomcamp
  A course by DataTalks Club that covers Spark, Kafka, Docker, Airflow, Terraform, DBT, Big Query etc
  ☆13Updated 3 years ago
• itversity / data-engineering-spark
  ☆87Updated 2 years ago
• rockthejvm / spark-optimization
  The official repository for the Rock the JVM Spark Optimization with Scala course
  ☆58Updated last year
• ssp-data / data-engineering-devops
  Full stack data engineering tools and infrastructure set-up
  ☆53Updated 4 years ago
• JoseRFJuniorLLMs / PySpark-ETL
  PySpark-ETL
  ☆23Updated 5 years ago
• ysfesr / Building-Data-LakeHouse
  Creation of a data lakehouse and an ELT pipeline to enable the efficient analysis and use of data
  ☆46Updated last year
• garystafford / streaming-sales-generator
  Streaming Synthetic Sales Data Generator: Streaming sales data generator for Apache Kafka, written in Python
  ☆44Updated 2 years ago
• panovvv / hadoop-hive-spark-docker
  Base Docker image with just essentials: Hadoop, Hive and Spark.
  ☆70Updated 4 years ago
• holdenk / spark-upgrade
  Magic to help Spark pipelines upgrade
  ☆35Updated 8 months ago
• bartosz25 / spark-scala-playground
  Sample processing code using Spark 2.1+ and Scala
  ☆51Updated 4 years ago
• simardeep1792 / Data-Engineering-Streaming-Project
  ☆40Updated 11 months ago
• LearningJournal / Spark-Streaming-In-Python
  Apache Spark 3 - Structured Streaming Course Material
  ☆121Updated last year
• mahmoudparsian / data-algorithms-with-spark
  O'Reilly Book: [Data Algorithms with Spark] by Mahmoud Parsian
  ☆216Updated 2 years ago
• NAVEENKUMARMURUGAN / Pyspark-ETL-Framework
  ☆14Updated 6 years ago
• guidok91 / spark-movies-etl
  Spark data pipeline that processes movie ratings data.
  ☆28Updated last week
• mehd-io / pyspark-boilerplate-mehdio
  Pyspark boilerplate for running prod ready data pipeline
  ☆28Updated 4 years ago
• marclamberti / webinar-airflow-chart
  Materials of the Official Helm Chart Webinar
  ☆27Updated 4 years ago
• Stefen-Taime / modern-data-pipeline
  reating a modern data pipeline using a combination of Terraform, AWS Lambda and S3, Snowflake, DBT, Mage AI, and Dash.
  ☆14Updated 2 years ago
• zhujun98 / data-engineering
  Spark, Airflow, Kafka
  ☆26Updated 2 years ago