brunocfnba / Kubernetes-AirflowLinks
Setup Apache Airflow on Kubernetes
☆10Updated 7 years ago
Alternatives and similar repositories for Kubernetes-Airflow
Users that are interested in Kubernetes-Airflow are comparing it to the libraries listed below
Sorting:
- A guide to running Airflow on Kubernetes☆173Updated 6 years ago
- An Airflow docker image preconfigured to work well with Spark and Hadoop/EMR☆175Updated 7 months ago
- scaffold of Apache Airflow executing Docker containers☆85Updated 3 years ago
- ☆202Updated 2 years ago
- Data validation library for PySpark 3.0.0☆33Updated 3 years ago
- A Helm chart to install Apache Airflow on Kubernetes☆290Updated 3 weeks ago
- Bare minimal Airflow on Kubernetes (Local, EKS, AKS)☆53Updated 5 years ago
- Astronomer Core Docker Images☆105Updated last year
- Airflow Unit Tests and Integration Tests☆261Updated 3 years ago
- pytest plugin to run the tests with support of pyspark☆87Updated 7 months ago
- Airflow training for the crunch conf☆104Updated 7 years ago
- Guide on how to setup Apache Airflow containers using Docker and IBM Bluemix☆11Updated 7 years ago
- A Getting Started Guide for developing and using Airflow Plugins☆93Updated 7 years ago
- ☆128Updated 5 years ago
- Pylint plugin for static code analysis on Airflow code☆96Updated 5 years ago
- Great Expectations Airflow operator☆169Updated last month
- Learn how to add data validation and documentation to a data pipeline built with dbt and Airflow.☆168Updated 2 years ago
- Visualize dependencies between Airflow DAGs☆49Updated 4 years ago
- Example DAGs using hooks and operators from Airflow Plugins☆347Updated 7 years ago
- Terraform module to deploy an Apache Airflow cluster on AWS, backed by RDS PostgreSQL for metadata, S3 for logs and SQS as message broker…☆84Updated 2 years ago
- Fast iterative local development and testing of Apache Airflow workflows☆202Updated 3 weeks ago
- Example for article Running Spark 3 with standalone Hive Metastore 3.0☆103Updated 2 years ago
- Quickstart PySpark with Anaconda on AWS/EMR using Terraform☆47Updated last year
- Quickly get a kubernetes executor airflow environment provisioned on GKE. Azure Kubernetes Service instructions included also as are inst…☆37Updated 5 years ago
- This code demonstrates the architecture featured on the AWS Big Data blog (https://aws.amazon.com/blogs/big-data/ ) which creates a concu…☆77Updated 7 years ago
- spark on kubernetes☆104Updated 2 years ago
- Use Airflow to move data from multiple MySQL databases to BigQuery☆100Updated 5 years ago
- Airflow Providers containing Deferrable Operators & Sensors from Astronomer☆149Updated last week
- Trino dbt demo project to mix and load BigQuery data with and in a local PostgreSQL database☆76Updated 4 years ago
- locopy: Loading/Unloading to Redshift and Snowflake using Python.☆115Updated this week