dataops-sre / docker-airflow2
Docker Apache Airflow 2
☆11Updated 2 years ago
Related projects ⓘ
Alternatives and complementary repositories for docker-airflow2
- Kafka variant of the MLOps Level 1 stack☆22Updated 2 years ago
- Project for real-time anomaly detection using Kafka and python☆56Updated last year
- Docker Apache Airflow☆19Updated 2 years ago
- Swiple enables you to easily observe, understand, validate and improve the quality of your data☆79Updated this week
- The practical use-cases of how to make your Machine Learning Pipelines robust and reliable using Apache Airflow.☆53Updated last year
- This is my Apache Airflow Local development setup on Windows 10 WSL2/Mac using docker-compose. It will also include some sample DAGs and …☆27Updated 9 months ago
- Learn how to add data validation and documentation to a data pipeline built with dbt and Airflow.☆166Updated last year
- Repo that relates to the Medium blog 'Keeping your ML model in shape with Kafka, Airflow' and MLFlow'☆119Updated last year
- ☆43Updated 2 years ago
- Get your MLOps (Level 1) platform started and going fast.☆119Updated last year
- A complete development environment setup for working with Airflow☆126Updated last year
- A Series of Notebooks on how to start with Kafka and Python☆153Updated last year
- The easiest way to run Airflow locally, with linting & tests for valid DAGs and Plugins.☆240Updated 3 years ago
- A repository of sample code to show data quality checking best practices using Airflow.☆72Updated last year
- This project helps me to understand the core concepts of Apache Airflow. I have created custom operators to perform tasks such as staging…☆73Updated 5 years ago
- Step by step development of a streaming pipeline in Python☆12Updated last year
- PyConDE & PyData Berlin 2019 Airflow Workshop: Airflow for machine learning pipelines.☆46Updated last year
- ☆13Updated 2 years ago
- Airflow training for the crunch conf☆105Updated 6 years ago
- A plugin for Apache Airflow that allows you to edit DAGs in browser☆401Updated last week
- Apache Airflow in Docker Compose (for both versions 1.10.* and 2.*)☆184Updated 11 months ago
- This set of code and instructions has the porpouse to instanciate a compiled environment with set of docker images like airflow webserver…☆3Updated last year
- A MLOps platform using prefect, mlflow, FastAPI, Prometheus/Grafana und streamlit☆73Updated 2 years ago
- An example of an ETL pipeline that lays out generic DE processes. This is now out of date but still provides useful information☆27Updated 2 years ago
- A repository about my first experimentation with the metaflow framework☆9Updated 4 years ago
- A self-contained, ready to run Airflow and Kafka project. Can be run locally or within codespaces.☆13Updated last year
- Astronomer Core Docker Images☆106Updated 5 months ago
- Use Airflow to move data from multiple MySQL databases to BigQuery☆99Updated 4 years ago
- Tutorial like code for how to deploy airflow using docker and how to use the DockerOperator.☆44Updated 4 years ago
- ☆31Updated last year