xnuinside / airflow_examples
Airflow Examples: code samples for Medium articles
☆12Updated 4 years ago
Alternatives and similar repositories for airflow_examples:
Users that are interested in airflow_examples are comparing it to the libraries listed below
- Sample Airflow DAGs to load data from the CovidTracking API to Snowflake via an AWS S3 intermediary.☆16Updated 4 years ago
- A repository of sample code to show data quality checking best practices using Airflow.☆74Updated last year
- Sample Airflow DAGs☆62Updated 2 years ago
- CICD pipeline that deploys a dbt image on a GKE cluster☆11Updated 3 years ago
- Execution of DBT models using Apache Airflow through Docker Compose☆114Updated 2 years ago
- Pylint plugin for static code analysis on Airflow code☆93Updated 4 years ago
- Materials for the next course☆24Updated 2 years ago
- Library which aim to generate kubernetes yamls templates from an Airflow dag using the Airflow Kuberntes Pod Operator☆10Updated 3 years ago
- Delux Airflow deployment with Minikube☆10Updated 4 years ago
- Complete data engineering pipeline running on Minikube Kubernetes, Argo CD, Spark, Trino, S3, Delta lake, Postgres+ Debezium CDC, MySQL,…☆28Updated last month
- Materials of the Official Helm Chart Webinar☆27Updated 3 years ago
- For a series of posts on Amazon MSK, Amazon EKS, and Amazon EMR☆65Updated 3 years ago
- Bare minimal Airflow on Kubernetes (Local, EKS, AKS)☆52Updated 4 years ago
- spark on kubernetes☆105Updated 2 years ago
- Pyspark boilerplate for running prod ready data pipeline☆28Updated 3 years ago
- Trino dbt demo project to mix and load BigQuery data with and in a local PostgreSQL database☆72Updated 3 years ago
- Data validation library for PySpark 3.0.0☆34Updated 2 years ago
- Any Airflow project day 1, you can spin up a local desktop Kubernetes Airflow environment AND one in Google Cloud Composer with tested da…☆111Updated last year
- A repository of sample code to accompany our blog post on Airflow and dbt.☆169Updated last year
- A dbt (data build tool) project you can use for testing purposes or experimentation☆36Updated last year
- ☆15Updated 10 months ago
- dbt (data build tool) projects targeting AWS analytics services (redshift, glue, emr, athena) and open table formats☆29Updated last year
- Airflow training for the crunch conf☆105Updated 6 years ago
- dbt Cloud pipelines in airflow examples☆35Updated last year
- Covid19 and Iowa Liquor Sales analysis at BigQuery using dbt, Airflow, Marquez, Google Cloud and other modern data stack tools☆14Updated 2 years ago
- Presto Trino with Apache Hive Postgres metastore☆40Updated 5 months ago
- 🐋 Docker image for AWS Glue Spark/Python☆23Updated last year
- Dockerizing an Apache Spark Standalone Cluster☆43Updated 2 years ago
- Soda Spark is a PySpark library that helps you with testing your data in Spark Dataframes☆63Updated 2 years ago
- A Python package that creates fine-grained dbt tasks on Apache Airflow☆64Updated 4 months ago