dataops-sre / docker-airflow2Links
Docker Apache Airflow 2
☆10Updated 3 years ago
Alternatives and similar repositories for docker-airflow2
Users that are interested in docker-airflow2 are comparing it to the libraries listed below
Sorting:
- Get your MLOps (Level 1) platform started and going fast.☆122Updated 2 years ago
- PyConDE & PyData Berlin 2019 Airflow Workshop: Airflow for machine learning pipelines.☆47Updated last year
- Learn how to add data validation and documentation to a data pipeline built with dbt and Airflow.☆169Updated last year
- Delta-Lake, ETL, Spark, Airflow☆47Updated 2 years ago
- Apache Airflow in Docker Compose (for both versions 1.10.* and 2.*)☆186Updated last year
- A real-time streaming ETL pipeline for streaming and performing sentiment analysis on Twitter data using Apache Kafka, Apache Spark and D…☆30Updated 4 years ago
- Project for real-time anomaly detection using Kafka and python☆58Updated 2 years ago
- This project helps me to understand the core concepts of Apache Airflow. I have created custom operators to perform tasks such as staging…☆91Updated 5 years ago
- streaming eight subreddits from reddit api using kafka producer & spark structured streaming.☆18Updated 3 months ago
- Kafka variant of the MLOps Level 1 stack☆25Updated 3 years ago
- ☆179Updated 2 years ago
- Docker Apache Airflow☆18Updated 3 years ago
- The practical use-cases of how to make your Machine Learning Pipelines robust and reliable using Apache Airflow.☆52Updated 2 years ago
- Evaluating the condition of a vehicle☆46Updated 2 years ago
- A Series of Notebooks on how to start with Kafka and Python☆153Updated 4 months ago
- This is my Apache Airflow Local development setup on Windows 10 WSL2/Mac using docker-compose. It will also include some sample DAGs and …☆31Updated last year
- A complete development environment setup for working with Airflow☆128Updated 2 years ago
- Example DAGs using hooks and operators from Airflow Plugins☆343Updated 6 years ago
- Orchestration of data science models in Apache Airflow, scale-up with Celery Executor and deploying in multiple Docker containers☆31Updated 4 years ago
- Data lake, data warehouse on GCP☆56Updated 3 years ago
- Big Data Demystified meetup and blog examples☆31Updated 11 months ago
- Step by step development of a streaming pipeline in Python☆12Updated 2 years ago
- Gradient Able - Open-Source Flask Dashboard | AppSeed☆66Updated 2 months ago
- Udacity Data Streaming Nanodegree Program☆22Updated 4 years ago
- Simple alert system implemented in Kafka and Python☆96Updated 7 years ago
- (project & tutorial) dag pipeline tests + ci/cd setup☆88Updated 4 years ago
- Code snippets for Data Engineering Design Patterns book☆128Updated 4 months ago
- Code examples on Apache Spark using python☆106Updated 2 years ago
- Data engineering interviews Q&A for data community by data community☆63Updated 5 years ago
- O'Reilly Book: [Data Algorithms with Spark] by Mahmoud Parsian☆216Updated 2 years ago