Alternatives and similar repositories for docker-livy

Users that are interested in docker-livy are comparing it to the libraries listed below

• developershomes / SparkETL
  Spark all the ETL Pipelines
  ☆34Updated 2 years ago
• cordon-thiago / airflow-spark
  Docker with Airflow and Spark standalone cluster
  ☆261Updated 2 years ago
• ovimihai / airflow-cert-dag-authoring
  Course notes for the Astronomer Certification DAG Authoring for Apache Airflow
  ☆53Updated last year
• josephmachado / beginner_de_project_stream
  Simple stream processing pipeline
  ☆108Updated last year
• vivek-bombatkar / Spark-with-Python---My-learning-notes-
  ETL pipeline using pyspark (Spark - Python)
  ☆116Updated 5 years ago
• itversity / data-engineering-spark
  ☆88Updated 3 years ago
• josephmachado / online_store
  End to end data engineering project
  ☆57Updated 2 years ago
• josephmachado / data_engineering_project_template
  A template repository to create a data project with IAC, CI/CD, Data migrations, & testing
  ☆277Updated last year
• Wittline / apache-spark-docker
  Dockerizing an Apache Spark Standalone Cluster
  ☆43Updated 3 years ago
• abhishek-ch / data-machinelearning-the-boring-way
  Build & Learn Data Engineering,Machine Learning over Kubernetes. No Shortcut approach.
  ☆57Updated 2 years ago
• LearningJournal / Spark-Streaming-In-Python
  Apache Spark 3 - Structured Streaming Course Material
  ☆123Updated 2 years ago
• josephmachado / spark_submit_airflow
  Simple repo to demonstrate how to submit a spark job to EMR from Airflow
  ☆34Updated 4 years ago
• bitsondatadev / trino-getting-started
  ☆267Updated 11 months ago
• ajupton / big-data-engineering-project
  Big Data Engineering practice project, including ETL with Airflow and Spark using AWS S3 and EMR
  ☆87Updated 6 years ago
• josephmachado / bitcoinMonitor
  Near real time ETL to populate a dashboard.
  ☆72Updated 2 weeks ago
• guidok91 / spark-movies-etl
  Spark data pipeline that processes movie ratings data.
  ☆30Updated 3 weeks ago
• josephmachado / data_engineering_best_practices
  Sample project to demonstrate data engineering best practices
  ☆196Updated last year
• dipankarmazumdar / awesome-lakehouse-guide
  Repo for everything open table formats (Iceberg, Hudi, Delta Lake) and the overall Lakehouse architecture
  ☆108Updated 3 months ago
• iam-mhaseeb / Skytrax-Data-Warehouse
  A full data warehouse infrastructure with ETL pipelines running inside docker on Apache Airflow for data orchestration, AWS Redshift for …
  ☆138Updated 5 years ago
• developer-advocacy-dremio / quick-guides-from-dremio
  Quick Guides from Dremio on Several topics
  ☆75Updated 2 weeks ago
• alanchn31 / Movalytics-Data-Warehouse
  Data pipeline performing ETL to AWS Redshift using Spark, orchestrated with Apache Airflow
  ☆155Updated 5 years ago
• soyelherein / pyspark-cicd-template
  PySpark data-pipeline testing and CICD
  ☆28Updated 4 years ago
• dominikhei / Local-Data-LakeHouse
  Sample Data Lakehouse deployed in Docker containers using Apache Iceberg, Minio, Trino and a Hive Metastore. Can be used for local testin…
  ☆74Updated 2 years ago
• supratim94336 / DataEngineeringCapstoneProject
  😈Complete End to End ETL Pipeline with Spark, Airflow, & AWS
  ☆49Updated 6 years ago
• Stefen-Taime / Iceberg-Dbt-Trino-Hive-modern-open-source-data-stack
  To provide a deeper understanding of how the modern, open-source data stack consisting of Iceberg, dbt, Trino, and Hive operates within a…
  ☆40Updated last year
• astronomer / airflow-dbt-demo
  A repository of sample code to accompany our blog post on Airflow and dbt.
  ☆177Updated 2 years ago
• vim89 / datapipelines-essentials-python
  Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…
  ☆55Updated 2 years ago
• bartosz25 / data-engineering-design-patterns-book
  Code snippets for Data Engineering Design Patterns book
  ☆191Updated 6 months ago
• arverma / TowardsDataEngineering
  This repo contains commands that data engineers use in day to day work.
  ☆61Updated 2 years ago
• TomLous / medium-spark-k8s
  Spark on Kubernetes using Helm
  ☆34Updated 5 years ago