xnuinside / airflow_examples
Airflow Examples: code samples for Medium articles
☆13Updated 4 years ago
Alternatives and similar repositories for airflow_examples:
Users that are interested in airflow_examples are comparing it to the libraries listed below
- A repository of sample code to show data quality checking best practices using Airflow.☆74Updated 2 years ago
- Sample Airflow DAGs to load data from the CovidTracking API to Snowflake via an AWS S3 intermediary.☆16Updated 4 years ago
- Complete data engineering pipeline running on Minikube Kubernetes, Argo CD, Spark, Trino, S3, Delta lake, Postgres+ Debezium CDC, MySQL,…☆28Updated 2 months ago
- Sample Airflow DAGs☆62Updated 2 years ago
- Execution of DBT models using Apache Airflow through Docker Compose☆116Updated 2 years ago
- Materials for the next course☆24Updated 2 years ago
- dbt package for monitoring airflow DAGs and tasks☆29Updated last month
- Data Engineering com Apache Spark☆42Updated 3 years ago
- ☆15Updated 11 months ago
- ☆43Updated 2 years ago
- Great Expectations Airflow operator☆161Updated this week
- Learn how to add data validation and documentation to a data pipeline built with dbt and Airflow.☆167Updated last year
- For a series of posts on Amazon MSK, Amazon EKS, and Amazon EMR☆66Updated 3 years ago
- Creates a Simulation of Fake Web Events☆84Updated 2 years ago
- Library to convert DBT manifest metadata to Airflow tasks☆48Updated last year
- ☆21Updated 3 years ago
- A custom sink provider for Apache Spark that sends the content of a dataframe to an AWS SQS☆23Updated 9 months ago
- ☆50Updated 4 years ago
- Trino dbt demo project to mix and load BigQuery data with and in a local PostgreSQL database☆73Updated 3 years ago
- ☆49Updated 3 years ago
- (project & tutorial) dag pipeline tests + ci/cd setup☆86Updated 4 years ago
- Demo DAGs that show how to run dbt Core in Airflow using Cosmos☆59Updated 5 months ago
- Terraform Provider for Airbyte API☆51Updated last month
- ☆38Updated 4 years ago
- Airflow Providers containing Deferrable Operators & Sensors from Astronomer☆146Updated this week
- This repo provides the Kubernetes Helm chart for deploying Pyspark Notebook.☆17Updated 2 years ago
- A repository of sample code to accompany our blog post on Airflow and dbt.☆171Updated last year
- Delta-Lake, ETL, Spark, Airflow☆46Updated 2 years ago
- CICD pipeline that deploys a dbt image on a GKE cluster☆11Updated 3 years ago
- Make simple storing test results and visualisation of these in a BI dashboard☆43Updated last week