astronomer / airflow-covid-data
Sample Airflow DAGs to load data from the CovidTracking API to Snowflake via an AWS S3 intermediary.
☆16Updated 3 years ago
Related projects ⓘ
Alternatives and complementary repositories for airflow-covid-data
- Execution of DBT models using Apache Airflow through Docker Compose☆113Updated last year
- A repository of sample code to show data quality checking best practices using Airflow.☆72Updated last year
- Data lake, data warehouse on GCP☆54Updated 2 years ago
- Sample Airflow DAGs☆61Updated 2 years ago
- Project files for the post: Running PySpark Applications on Amazon EMR using Apache Airflow: Using the new Amazon Managed Workflows for A…☆41Updated 2 years ago
- ☆14Updated last year
- ☆15Updated 3 months ago
- data engineering 100 days 🤖 🧲 🦾 | #DE☆37Updated last year
- Airflow Examples: code samples for Medium articles☆12Updated 3 years ago
- ☆20Updated 3 years ago
- The go to demo for public and private dbt Learn☆69Updated 2 months ago
- ☆66Updated last month
- Hadoop/Hive/Spark container to perform CI tests☆11Updated 3 years ago
- build dw with dbt☆29Updated 3 weeks ago
- ☆48Updated 3 years ago
- Full stack data engineering tools and infrastructure set-up☆44Updated 3 years ago
- Rules based grant management for Snowflake☆40Updated 5 years ago
- dbt Cloud pipelines in airflow examples☆35Updated last year
- ☆13Updated 9 months ago
- ☆13Updated 2 years ago
- Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…☆53Updated last year
- Code snippets for Data Engineering Design Patterns book☆40Updated last week
- (project & tutorial) dag pipeline tests + ci/cd setup☆85Updated 3 years ago
- Materials for the next course☆22Updated last year
- Project for "Data pipeline design patterns" blog.☆41Updated 3 months ago
- Code for dbt tutorial☆143Updated 5 months ago
- Spark data pipeline that processes movie ratings data.☆27Updated last week
- Cloned by the `dbt init` task☆59Updated 6 months ago
- This project demonstrates how to build and automate an ETL pipeline using DAGs in Airflow and load the transformed data to Bigquery. Ther…☆19Updated 3 weeks ago
- A repository of sample code to accompany our blog post on Airflow and dbt.☆168Updated last year