panovvv / airflow-livy-operatorsLinks
Lets Airflow DAGs run Spark jobs via Livy: sessions and/or batches.
☆18Updated 2 years ago
Alternatives and similar repositories for airflow-livy-operators
Users that are interested in airflow-livy-operators are comparing it to the libraries listed below
Sorting:
- A process that runs in unison with Apache Airflow to control the Scheduler process to ensure High Availability☆235Updated 3 years ago
- A docker image and kubernetes config files to run Airflow on Kubernetes☆655Updated 6 years ago
- An Airflow docker image preconfigured to work well with Spark and Hadoop/EMR☆175Updated 3 months ago
- Airflow plugin to export dag and task based metrics to Prometheus.☆259Updated 3 months ago
- A plugin for Apache Airflow that exposes rest end points for the Command Line Interfaces☆326Updated 4 years ago
- A guide to running Airflow on Kubernetes☆173Updated 6 years ago
- Spark on Kubernetes infrastructure Helm charts repo☆204Updated 2 years ago
- A Helm chart to install Apache Airflow on Kubernetes☆288Updated this week
- ☆127Updated 5 years ago
- ETL best practices with airflow, with examples☆1,342Updated 11 months ago
- Guides and docs to help you get up and running with Apache Airflow.☆809Updated last month
- Helm Charts for the Astronomer Platform, Apache Airflow as a Service on Kubernetes☆479Updated this week
- Kubernetes custom controller and CRDs to managing Airflow☆299Updated 5 years ago
- A boilerplate for writing PySpark Jobs☆394Updated last year
- ☆201Updated last year
- Airflow basics tutorial☆397Updated 4 years ago
- The User-Community Airflow Helm Chart is the standard way to deploy Apache Airflow on Kubernetes with Helm. Originally created in 2017, i…☆697Updated 10 months ago
- A convenient Python wrapper for Apache NiFi☆262Updated this week
- A series of DAGs/Workflows to help maintain the operation of Airflow☆1,741Updated last year
- Cloudera deployment automation with Ansible☆198Updated 4 years ago
- Lightweight proxy to expose the UI of an Apache Spark cluster that is behind a firewall☆98Updated 5 years ago
- A simple spark standalone cluster for your testing environment purposses☆573Updated last year
- ☆525Updated this week
- Bare minimal Airflow on Kubernetes (Local, EKS, AKS)☆53Updated 5 years ago
- Airflow Unit Tests and Integration Tests☆260Updated 2 years ago
- spark on kubernetes☆104Updated 2 years ago
- Prometheus Exporter for Airflow☆161Updated last year
- A template repo for building and releasing Airflow provider packages.☆72Updated last year
- An Integrated and collaborative cloud environment for building and running Spark applications on PKS/Kubernetes☆84Updated 5 years ago
- [EXPERIMENTAL] This repo includes deployment instructions for running HDFS/Spark inside docker containers. Also includes spark-notebook a…☆695Updated 4 years ago