jghoman / awesome-apache-airflow
Curated list of resources about Apache Airflow
☆3,722Updated 4 months ago
Alternatives and similar repositories for awesome-apache-airflow:
Users that are interested in awesome-apache-airflow are comparing it to the libraries listed below
- A series of DAGs/Workflows to help maintain the operation of Airflow☆1,697Updated 7 months ago
- ETL best practices with airflow, with examples☆1,313Updated 3 months ago
- Guides and docs to help you get up and running with Apache Airflow.☆804Updated 2 years ago
- Dynamically generate Apache Airflow DAGs from YAML configuration files☆1,231Updated this week
- Docker Apache Airflow☆3,790Updated last year
- Apache Airflow tutorial☆941Updated 2 years ago
- Code for Data Pipelines with Apache Airflow☆736Updated 5 months ago
- A curated list of awesome ETL frameworks, libraries, and software.☆3,319Updated 5 months ago
- A curated list of data engineering tools for software developers☆465Updated 7 years ago
- A list of useful resources to learn Data Engineering from scratch☆3,596Updated 6 months ago
- Data quality testing for the modern data stack (SQL, Spark, and Pandas) https://www.soda.io☆1,973Updated this week
- A curated list of data engineering tools for software developers☆6,964Updated 2 months ago
- Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.☆3,348Updated this week
- A docker image and kubernetes config files to run Airflow on Kubernetes☆655Updated 5 years ago
- A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow☆2,081Updated last year
- The User-Community Airflow Helm Chart is the standard way to deploy Apache Airflow on Kubernetes with Helm. Originally created in 2017, i…☆671Updated 3 months ago
- A curated list of awesome Apache Spark packages and resources.☆1,743Updated 2 months ago
- Amundsen is a metadata driven application for improving the productivity of data analysts, data scientists and engineers when interacting…☆4,474Updated last week
- A curated list of awesome pipeline toolkits inspired by Awesome Sysadmin☆6,241Updated last month
- Helm Charts for the Astronomer Platform, Apache Airflow as a Service on Kubernetes☆467Updated this week
- Always know what to expect from your data.☆10,117Updated this week
- Collect, aggregate, and visualize a data ecosystem's metadata☆1,819Updated this week
- Implementing best practices for PySpark ETL jobs and applications.☆1,736Updated 2 years ago
- An Awesome List of Open-Source Data Engineering Projects☆2,226Updated 3 months ago
- A plugin for Apache Airflow that allows you to edit DAGs in browser☆413Updated this week
- An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.☆1,340Updated 4 years ago
- The easiest way to run Airflow locally, with linting & tests for valid DAGs and Plugins.☆242Updated 3 years ago
- An orchestration platform for the development, production, and observation of data assets.☆12,300Updated this week
- A Data Engineering & Machine Learning Knowledge Hub☆1,119Updated 11 months ago
- Airflow basics tutorial☆398Updated 3 years ago