marclamberti / docker-airflow
Docker Airflow - Contains a docker compose file for Airflow 2.0
☆65Updated 2 years ago
Alternatives and similar repositories for docker-airflow:
Users that are interested in docker-airflow are comparing it to the libraries listed below
- A repository of sample code to show data quality checking best practices using Airflow.☆74Updated last year
- Code for dbt tutorial☆151Updated 8 months ago
- Execution of DBT models using Apache Airflow through Docker Compose☆114Updated 2 years ago
- Project for "Data pipeline design patterns" blog.☆43Updated 6 months ago
- Docker with Airflow and Spark standalone cluster☆249Updated last year
- Simple stream processing pipeline☆98Updated 8 months ago
- Delta-Lake, ETL, Spark, Airflow☆46Updated 2 years ago
- Delta Lake examples☆217Updated 4 months ago
- End to end data engineering project☆53Updated 2 years ago
- Code snippets for Data Engineering Design Patterns book☆69Updated 2 weeks ago
- A workspace to experiment with Apache Spark, Livy, and Airflow in a Docker environment.☆39Updated 3 years ago
- Spark data pipeline that processes movie ratings data.☆28Updated 3 weeks ago
- Apache Airflow in Docker Compose (for both versions 1.10.* and 2.*)☆184Updated last year
- Simple repo to demonstrate how to submit a spark job to EMR from Airflow☆32Updated 4 years ago
- This project helps me to understand the core concepts of Apache Airflow. I have created custom operators to perform tasks such as staging…☆76Updated 5 years ago
- Example repo to create end to end tests for data pipeline.☆22Updated 8 months ago
- A repository of sample code to accompany our blog post on Airflow and dbt.☆169Updated last year
- Data pipeline performing ETL to AWS Redshift using Spark, orchestrated with Apache Airflow☆137Updated 4 years ago
- A CLI tool to streamline getting started with Apache Airflow™ and managing multiple Airflow projects☆209Updated last week
- Repo for CDC with debezium blog post☆27Updated 5 months ago
- Data lake, data warehouse on GCP☆55Updated 3 years ago
- Resources for video demonstrations and blog posts related to DataOps on AWS☆172Updated 3 years ago
- Materials for the next course☆24Updated 2 years ago
- Data pipeline with dbt, Airflow, Great Expectations☆160Updated 3 years ago
- Streaming Synthetic Sales Data Generator: Streaming sales data generator for Apache Kafka, written in Python☆42Updated 2 years ago
- Step-by-step tutorial on building a Kimball dimensional model with dbt☆126Updated 7 months ago
- A Python package that creates fine-grained dbt tasks on Apache Airflow☆64Updated 4 months ago
- The resources of the preparation course for Databricks Data Engineer Professional certification exam☆102Updated this week
- A modern ELT demo using airbyte, dbt, snowflake and dagster☆26Updated 2 years ago
- Code for my "Efficient Data Processing in SQL" book.☆56Updated 6 months ago