MichaelShoemaker / airflow3.0-docker-composeLinks
Docker Compose Template for Single Node Airflow 3.0
☆17Updated 5 months ago
Alternatives and similar repositories for airflow3.0-docker-compose
Users that are interested in airflow3.0-docker-compose are comparing it to the libraries listed below
Sorting:
- Produce Kafka messages, consume them and upload into Cassandra, MongoDB.☆43Updated 2 years ago
- Delta-Lake, ETL, Spark, Airflow☆48Updated 3 years ago
- Get data from API, run a scheduled script with Airflow, send data to Kafka and consume with Spark, then write to Cassandra☆144Updated 2 years ago
- build dw with dbt☆50Updated last year
- ☆41Updated 3 years ago
- Source code of the Apache Airflow Tutorial for Beginners on YouTube Channel Coder2j (https://www.youtube.com/c/coder2j)☆336Updated last year
- Python data repo, jupyter notebook, python scripts and data.☆549Updated last year
- Code for dbt tutorial☆167Updated 5 months ago
- A portable Datamart and Business Intelligence suite built with Docker, Airflow, dbt, duckdb and Superset☆46Updated last month
- A self-contained, ready to run Airflow ELT project. Can be run locally or within codespaces.☆80Updated 2 years ago
- Building a Data Pipeline with an Open Source Stack☆55Updated 7 months ago
- Notebooks/scripts for youtube tutorials☆68Updated last year
- ☆29Updated 2 years ago
- End to end data engineering project with kafka, airflow, spark, postgres and docker.☆108Updated last month
- ☆21Updated 2 years ago
- Streamlit Application for Analyzing Bundesliga Data☆76Updated 2 years ago
- Docker with Airflow + Postgres + Spark cluster + JDK (spark-submit support) + Jupyter Notebooks☆24Updated 3 years ago
- Writes the CSV file to Postgres, read table and modify it. Write more tables to Postgres with Airflow.☆38Updated 2 years ago
- A repository that makes it easy to get up and running with Prefect 2 using Docker Compose.☆140Updated 9 months ago
- Code for blog at: https://www.startdataengineering.com/post/docker-for-de/☆40Updated last year
- Project for "Data pipeline design patterns" blog.☆50Updated last year
- ☆45Updated last year
- Templates for your Kedro projects.☆83Updated last week
- This project demonstrates how to build and automate an ETL pipeline using DAGs in Airflow and load the transformed data to Bigquery. Ther…☆25Updated 5 months ago
- Recency, Frequency, and Monetary are three behavioral attributes and are quite simple, in that they can be easily computed for any databa…☆15Updated 2 months ago
- Local Environment to Practice Data Engineering☆144Updated last year
- Code snippets for Data Engineering Design Patterns book☆331Updated last month
- Surfalytics projces on Data Engineering and Analytics☆115Updated 2 months ago
- Example project with a CNN to train a Pokémon type classifier, adapted for DTC workshop☆36Updated 2 years ago
- This repository serves as a comprehensive guide to effective data modeling and robust data quality assurance using popular open-source to…☆39Updated 2 years ago