skhatri / airflow-by-exampleLinks
Bunch of Airflow Configurations and DAGs for Kubernetes, Spark based data-pipelines. Scale inside Kubernetes using spark kubernetes master. Secure it with keycloak
☆23Updated 3 years ago
Alternatives and similar repositories for airflow-by-example
Users that are interested in airflow-by-example are comparing it to the libraries listed below
Sorting:
- (project & tutorial) dag pipeline tests + ci/cd setup☆88Updated 4 years ago
- Learn how to add data validation and documentation to a data pipeline built with dbt and Airflow.☆169Updated last year
- A repository of sample code to show data quality checking best practices using Airflow.☆78Updated 2 years ago
- triggering a DAG run multiple times☆88Updated last year
- Enforce Best Practices for all your Airflow DAGs. ⭐☆104Updated this week
- Example DAGs using hooks and operators from Airflow Plugins☆347Updated 7 years ago
- Astronomer Core Docker Images☆107Updated last year
- A CLI tool to streamline getting started with Apache Airflow™ and managing multiple Airflow projects☆220Updated 4 months ago
- Great Expectations Airflow operator☆167Updated this week
- Data pipeline with dbt, Airflow, Great Expectations☆163Updated 4 years ago
- ☆201Updated last year
- Airflow Providers containing Deferrable Operators & Sensors from Astronomer☆149Updated this week
- ☆48Updated 3 years ago
- A Helm chart to install Apache Airflow on Kubernetes☆288Updated this week
- ☆23Updated 4 years ago
- Trino dbt demo project to mix and load BigQuery data with and in a local PostgreSQL database☆76Updated 4 years ago
- Pylint plugin for static code analysis on Airflow code☆95Updated 4 years ago
- Airflow Unit Tests and Integration Tests☆260Updated 2 years ago
- Code examples showing flow deployment to various types of infrastructure☆109Updated 2 years ago
- Fast iterative local development and testing of Apache Airflow workflows☆201Updated 3 weeks ago
- ☆51Updated 5 years ago
- locopy: Loading/Unloading to Redshift and Snowflake using Python.☆112Updated last month
- Making DAG construction easier☆271Updated last month
- Make simple storing test results and visualisation of these in a BI dashboard☆46Updated this week
- A Python package that creates fine-grained dbt tasks on Apache Airflow☆70Updated 3 weeks ago
- ☆30Updated 2 years ago
- Airflow training for the crunch conf☆105Updated 6 years ago
- Astro SDK allows rapid and clean development of {Extract, Load, Transform} workflows using Python and SQL, powered by Apache Airflow.☆375Updated 3 months ago
- New generation opensource data stack☆72Updated 3 years ago
- A provider package for kafka☆37Updated 2 years ago