skhatri / airflow-by-exampleLinks
Bunch of Airflow Configurations and DAGs for Kubernetes, Spark based data-pipelines. Scale inside Kubernetes using spark kubernetes master. Secure it with keycloak
☆23Updated 3 years ago
Alternatives and similar repositories for airflow-by-example
Users that are interested in airflow-by-example are comparing it to the libraries listed below
Sorting:
- A repository of sample code to show data quality checking best practices using Airflow.☆78Updated 2 years ago
- Great Expectations Airflow operator☆169Updated last week
- Learn how to add data validation and documentation to a data pipeline built with dbt and Airflow.☆168Updated 2 years ago
- Astronomer Core Docker Images☆106Updated last year
- A CLI tool to streamline getting started with Apache Airflow™ and managing multiple Airflow projects☆224Updated 7 months ago
- (project & tutorial) dag pipeline tests + ci/cd setup☆89Updated 4 years ago
- Enforce Best Practices for all your Airflow DAGs. ⭐☆106Updated last week
- Airflow Providers containing Deferrable Operators & Sensors from Astronomer☆149Updated last week
- The Python fake data producer for Apache Kafka® is a complete demo app allowing you to quickly produce JSON fake streaming datasets and …☆85Updated last year
- Pylint plugin for static code analysis on Airflow code☆96Updated 5 years ago
- Making DAG construction easier☆281Updated 2 months ago
- Airflow training for the crunch conf☆104Updated 7 years ago
- A Helm chart to install Apache Airflow on Kubernetes☆290Updated this week
- Fast iterative local development and testing of Apache Airflow workflows☆202Updated 3 months ago
- triggering a DAG run multiple times☆88Updated last year
- Data pipeline with dbt, Airflow, Great Expectations☆165Updated 4 years ago
- Example DAGs using hooks and operators from Airflow Plugins☆347Updated 7 years ago
- Read Delta tables without any Spark☆47Updated last year
- Snowflake SQLAlchemy☆261Updated this week
- scaffold of Apache Airflow executing Docker containers☆85Updated 3 years ago
- Code examples showing flow deployment to various types of infrastructure☆111Updated 2 years ago
- ☆23Updated 4 years ago
- New generation opensource data stack☆76Updated 3 years ago
- Make simple storing test results and visualisation of these in a BI dashboard☆52Updated 2 months ago
- A simple and easy to use Data Quality (DQ) tool built with Python.☆50Updated 2 years ago
- Astro SDK allows rapid and clean development of {Extract, Load, Transform} workflows using Python and SQL, powered by Apache Airflow.☆377Updated 6 months ago
- locopy: Loading/Unloading to Redshift and Snowflake using Python.☆114Updated last week
- Tutorials for Fugue - A unified interface for distributed computing. Fugue executes SQL, Python, and Pandas code on Spark and Dask withou…☆114Updated last month
- ☆202Updated 2 years ago
- Trino dbt demo project to mix and load BigQuery data with and in a local PostgreSQL database☆77Updated 4 years ago