ednarb29 / docker-airflowLinks
Docker Apache Airflow
☆18Updated 3 years ago
Alternatives and similar repositories for docker-airflow
Users that are interested in docker-airflow are comparing it to the libraries listed below
Sorting:
- Learn Apache Spark in Scala, Python (PySpark) and R (SparkR) by building your own cluster with a JupyterLab interface on Docker.☆495Updated 2 years ago
- New Generation Opensource Data Stack Demo☆435Updated 2 years ago
- Airflow Unit Tests and Integration Tests☆260Updated 2 years ago
- Example DAGs using hooks and operators from Airflow Plugins☆343Updated 6 years ago
- Repo that relates to the Medium blog 'Keeping your ML model in shape with Kafka, Airflow' and MLFlow'☆121Updated 2 years ago
- The easiest way to run Airflow locally, with linting & tests for valid DAGs and Plugins.☆255Updated 4 years ago
- Learn how to add data validation and documentation to a data pipeline built with dbt and Airflow.☆169Updated last year
- Apache Airflow in Docker Compose (for both versions 1.10.* and 2.*)☆186Updated last year
- pyspark methods to enhance developer productivity 📣 👯 🎉☆674Updated 4 months ago
- Tutorial for setting up a Spark cluster running inside of Docker containers located on different machines☆133Updated 2 years ago
- Tutorial like code for how to deploy airflow using docker and how to use the DockerOperator.☆44Updated 5 years ago
- Guides and docs to help you get up and running with Apache Airflow.☆807Updated 2 years ago
- Great Expectations Airflow operator☆167Updated this week
- A Python Library to support running data quality rules while the spark job is running⚡☆188Updated this week
- dbt-spark contains all of the code enabling dbt to work with Apache Spark and Databricks☆436Updated this week
- A complete development environment setup for working with Airflow☆128Updated 2 years ago
- Docker with Airflow and Spark standalone cluster☆261Updated last year
- A repository of sample code to accompany our blog post on Airflow and dbt.☆174Updated last year
- ☆200Updated last year
- Delta-Lake, ETL, Spark, Airflow☆47Updated 2 years ago
- A plugin for Apache Airflow that allows you to edit DAGs in browser☆439Updated last month
- (project & tutorial) dag pipeline tests + ci/cd setup☆88Updated 4 years ago
- Data pipeline with dbt, Airflow, Great Expectations☆163Updated 4 years ago
- PyConDE & PyData Berlin 2019 Airflow Workshop: Airflow for machine learning pipelines.☆47Updated last year
- This project helps me to understand the core concepts of Apache Airflow. I have created custom operators to perform tasks such as staging…☆91Updated 5 years ago
- A simple spark standalone cluster for your testing environment purposses☆572Updated last year
- Delta Lake examples☆226Updated 9 months ago
- Pythonic Programming Framework to orchestrate jobs in Databricks Workflow☆218Updated last month
- Data validation library for PySpark 3.0.0☆33Updated 2 years ago
- Playground for Lakehouse (Iceberg, Hudi, Spark, Flink, Trino, DBT, Airflow, Kafka, Debezium CDC)☆59Updated last year