astronomer / airflow-covid-dataLinks
Sample Airflow DAGs to load data from the CovidTracking API to Snowflake via an AWS S3 intermediary.
☆16Updated 4 years ago
Alternatives and similar repositories for airflow-covid-data
Users that are interested in airflow-covid-data are comparing it to the libraries listed below
Sorting:
- ☆18Updated last year
- Analytics engineering with dbt - projects and developer environment☆19Updated 9 months ago
- Streaming Synthetic Sales Data Generator: Streaming sales data generator for Apache Kafka, written in Python☆44Updated 2 years ago
- Sample Airflow DAGs☆62Updated 2 years ago
- Execution of DBT models using Apache Airflow through Docker Compose☆117Updated 2 years ago
- Source code for the YouTube video, Apache Beam Explained in 12 Minutes☆21Updated 4 years ago
- Developed a data pipeline to automate data warehouse ETL by building custom airflow operators that handle the extraction, transformation,…☆90Updated 3 years ago
- Slowly Changing Dimension type 2 using Hive query language using exclusive join technique with ORC Hive tables, partitioned and clustered…☆16Updated 6 years ago
- ☆48Updated 3 years ago
- ☆14Updated 2 years ago
- Public source code for the Batch Processing with Apache Beam (Python) online course☆18Updated 4 years ago
- A repository of sample code to show data quality checking best practices using Airflow.☆77Updated 2 years ago
- ☆12Updated 3 years ago
- Full stack data engineering tools and infrastructure set-up☆53Updated 4 years ago
- Data lake, data warehouse on GCP☆56Updated 3 years ago
- The Python fake data producer for Apache Kafka® is a complete demo app allowing you to quickly produce JSON fake streaming datasets and …☆85Updated last year
- A full data warehouse infrastructure with ETL pipelines running inside docker on Apache Airflow for data orchestration, AWS Redshift for …☆137Updated 5 years ago
- CICD pipeline that deploys a dbt image on a GKE cluster☆11Updated 4 years ago
- data engineering 100 days 🤖 🧲 🦾 | #DE☆39Updated last year
- Spark data pipeline that processes movie ratings data.☆29Updated last week
- Project files for the post: Running PySpark Applications on Amazon EMR using Apache Airflow: Using the new Amazon Managed Workflows for A…☆41Updated 3 years ago
- New generation opensource data stack☆70Updated 3 years ago
- Intended for internal use: deploys all infrastructure required for Astronomer to run on GCP☆10Updated 2 months ago
- Apache Airflow advanced functionalities examples☆19Updated last year
- Materials of the Official Helm Chart Webinar☆27Updated 4 years ago
- Big Data Demystified meetup and blog examples☆31Updated 11 months ago
- Quickstart PySpark with Anaconda on AWS/EMR using Terraform☆47Updated 6 months ago
- The go to demo for public and private dbt Learn☆78Updated 3 months ago
- ☆17Updated 11 months ago
- Docker Airflow - Contains a docker compose file for Airflow 2.0☆68Updated 2 years ago