Alternatives and similar repositories for spark-livy-on-airflow-workspace:

Users that are interested in spark-livy-on-airflow-workspace are comparing it to the libraries listed below

• cordon-thiago / airflow-spark
  Docker with Airflow and Spark standalone cluster
  ☆247Updated last year
• josephmachado / spark_submit_airflow
  Simple repo to demonstrate how to submit a spark job to EMR from Airflow
  ☆32Updated 4 years ago
• garystafford / tickit-data-lake-demo
  Resources for video demonstrations and blog posts related to DataOps on AWS
  ☆172Updated 2 years ago
• sdesilva26 / docker-spark
  Tutorial for setting up a Spark cluster running inside of Docker containers located on different machines
  ☆126Updated 2 years ago
• LearningJournal / Spark-Streaming-In-Python
  Apache Spark 3 - Structured Streaming Course Material
  ☆121Updated last year
• yTek01 / docker-spark-airflow
  ☆34Updated last year
• greatexpectationslabs / ge_tutorials
  Learn how to add data validation and documentation to a data pipeline built with dbt and Airflow.
  ☆166Updated last year
• delta-io / delta-examples
  Delta Lake examples
  ☆214Updated 3 months ago
• arezamoosavi / AcidOnSpark-ETL
  Delta-Lake, ETL, Spark, Airflow
  ☆45Updated 2 years ago
• ovimihai / airflow-cert-dag-authoring
  Course notes for the Astronomer Certification DAG Authoring for Apache Airflow
  ☆52Updated 9 months ago
• mrn-aglic / spark-standalone-cluster
  This repo contains a spark standalone cluster on docker for anyone who wants to play with PySpark by submitting their applications.
  ☆28Updated last year
• vim89 / datapipelines-essentials-python
  Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…
  ☆53Updated last year
• konosp / dbt-airflow-docker-compose
  Execution of DBT models using Apache Airflow through Docker Compose
  ☆113Updated 2 years ago
• jamesshocking / Spark-REST-API-UDF
  Example of how to leverage Apache Spark distributed capabilities to call REST-API using a UDF
  ☆50Updated 2 years ago
• danielbeach / unitTestPySpark
  how to unit test your PySpark code
  ☆28Updated 3 years ago
• akashmehta10 / profiling_pyspark
  ☆25Updated last year
• astronomer / airflow-provider-great-expectations
  Great Expectations Airflow operator
  ☆160Updated 2 months ago
• marcosmarxm / airflow-testing-ci-workflow
  (project & tutorial) dag pipeline tests + ci/cd setup
  ☆86Updated 3 years ago
• astronomer / airflow-dbt-demo
  A repository of sample code to accompany our blog post on Airflow and dbt.
  ☆168Updated last year
• astronomer / airflow-data-quality-demo
  A repository of sample code to show data quality checking best practices using Airflow.
  ☆74Updated last year
• mehd-io / pyspark-boilerplate-mehdio
  Pyspark boilerplate for running prod ready data pipeline
  ☆28Updated 3 years ago
• cluster-apps-on-docker / spark-standalone-cluster-on-docker
  Learn Apache Spark in Scala, Python (PySpark) and R (SparkR) by building your own cluster with a JupyterLab interface on Docker.
  ☆473Updated 2 years ago
• alexandraabbas / apache-airflow-course
  Public source code for the Udemy online course Apache Airflow: Complete Hands-On Beginner to Advanced Class.
  ☆62Updated 4 years ago
• ananthdurai / airflow-training
  Airflow training for the crunch conf
  ☆104Updated 6 years ago
• pyjaime / docker-airflow-spark
  Docker with Airflow + Postgres + Spark cluster + JDK (spark-submit support) + Jupyter Notebooks
  ☆21Updated 2 years ago
• garystafford / aws-airflow-demo
  Project files for the post: Running PySpark Applications on Amazon EMR using Apache Airflow: Using the new Amazon Managed Workflows for A…
  ☆41Updated 2 years ago
• xnuinside / airflow_in_docker_compose
  Apache Airflow in Docker Compose (for both versions 1.10.* and 2.*)
  ☆183Updated last year
• sarahmk125 / airflow-docker-metrics
  ☆43Updated 2 years ago