marclamberti / docker-airflow
Docker Airflow - Contains a docker compose file for Airflow 2.0
☆65Updated 2 years ago
Alternatives and similar repositories for docker-airflow
Users that are interested in docker-airflow are comparing it to the libraries listed below
Sorting:
- Docker with Airflow and Spark standalone cluster☆257Updated last year
- Resources for video demonstrations and blog posts related to DataOps on AWS☆176Updated 3 years ago
- A repository of sample code to show data quality checking best practices using Airflow.☆77Updated 2 years ago
- Code snippets for Data Engineering Design Patterns book☆106Updated last month
- Code for dbt tutorial☆157Updated 11 months ago
- Execution of DBT models using Apache Airflow through Docker Compose☆116Updated 2 years ago
- Simple stream processing pipeline☆102Updated 10 months ago
- Delta-Lake, ETL, Spark, Airflow☆47Updated 2 years ago
- Spark data pipeline that processes movie ratings data.☆28Updated last month
- A repository of sample code to accompany our blog post on Airflow and dbt.☆172Updated last year
- Project for "Data pipeline design patterns" blog.☆45Updated 9 months ago
- Simple repo to demonstrate how to submit a spark job to EMR from Airflow☆33Updated 4 years ago
- Data lake, data warehouse on GCP☆56Updated 3 years ago
- Data pipeline performing ETL to AWS Redshift using Spark, orchestrated with Apache Airflow☆144Updated 4 years ago
- Example repository showing how to build a data platform with Prefect, dbt and Snowflake☆100Updated 2 years ago
- A collection of Airflow operators, hooks, and utilities to elevate dbt to a first-class citizen of Airflow.☆198Updated last week
- Apache Airflow in Docker Compose (for both versions 1.10.* and 2.*)☆186Updated last year
- A template repository to create a data project with IAC, CI/CD, Data migrations, & testing☆261Updated 10 months ago
- A CLI tool to streamline getting started with Apache Airflow™ and managing multiple Airflow projects☆219Updated 2 weeks ago
- Pyspark boilerplate for running prod ready data pipeline☆28Updated 4 years ago
- Materials for the next course☆24Updated 2 years ago
- Delta Lake examples☆224Updated 7 months ago
- Near real time ETL to populate a dashboard.☆72Updated 10 months ago
- End to end data engineering project☆54Updated 2 years ago
- Learn how to add data validation and documentation to a data pipeline built with dbt and Airflow.☆168Updated last year
- The resources of the preparation course for Databricks Data Engineer Professional certification exam☆114Updated last month
- Sample project to demonstrate data engineering best practices☆190Updated last year
- Sample Data Lakehouse deployed in Docker containers using Apache Iceberg, Minio, Trino and a Hive Metastore. Can be used for local testin…☆69Updated last year
- Template for Data Engineering and Data Pipeline projects☆110Updated 2 years ago
- Course notes for the Astronomer Certification DAG Authoring for Apache Airflow☆52Updated last year