jghoman / awesome-apache-airflow
Curated list of resources about Apache Airflow
☆3,750Updated 7 months ago
Alternatives and similar repositories for awesome-apache-airflow:
Users that are interested in awesome-apache-airflow are comparing it to the libraries listed below
- ETL best practices with airflow, with examples☆1,321Updated 5 months ago
- Guides and docs to help you get up and running with Apache Airflow.☆806Updated 2 years ago
- Docker Apache Airflow☆3,799Updated 2 years ago
- A series of DAGs/Workflows to help maintain the operation of Airflow☆1,713Updated 9 months ago
- Dynamically generate Apache Airflow DAGs from YAML configuration files☆1,269Updated this week
- Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.☆3,385Updated 2 weeks ago
- A curated list of awesome ETL frameworks, libraries, and software.☆3,369Updated 8 months ago
- Amundsen is a metadata driven application for improving the productivity of data analysts, data scientists and engineers when interacting…☆4,534Updated last week
- A curated list of awesome Apache Spark packages and resources.☆1,767Updated 5 months ago
- A curated list of data engineering tools for software developers☆7,210Updated last week
- Code for Data Pipelines with Apache Airflow☆762Updated 7 months ago
- Data quality testing for the modern data stack (SQL, Spark, and Pandas) https://www.soda.io☆2,046Updated this week
- An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.☆1,360Updated 5 years ago
- Apache Airflow tutorial☆941Updated 2 years ago
- Python API for Deequ☆754Updated 5 months ago
- A docker image and kubernetes config files to run Airflow on Kubernetes☆654Updated 5 years ago
- A curated list of data engineering tools for software developers☆481Updated 7 years ago
- An Open Standard for lineage metadata collection☆1,879Updated this week
- dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build application…☆10,554Updated this week
- A plugin for Apache Airflow that allows you to edit DAGs in browser☆418Updated this week
- Implementing best practices for PySpark ETL jobs and applications.☆1,854Updated 2 years ago
- An Awesome List of Open-Source Data Engineering Projects☆2,404Updated 5 months ago
- Collect, aggregate, and visualize a data ecosystem's metadata☆1,879Updated this week
- Always know what to expect from your data.☆10,273Updated this week
- Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark☆1,497Updated 3 months ago
- Airflow basics tutorial☆397Updated 3 years ago
- A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow☆2,081Updated last year
- An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Tr…☆7,890Updated this week
- pyspark methods to enhance developer productivity 📣 👯 🎉☆666Updated 2 weeks ago
- Helm Charts for the Astronomer Platform, Apache Airflow as a Service on Kubernetes☆470Updated this week