databand-ai / awesome-apache-airflowLinks
Curated list of resources about Apache Airflow
☆19Updated 4 years ago
Alternatives and similar repositories for awesome-apache-airflow
Users that are interested in awesome-apache-airflow are comparing it to the libraries listed below
Sorting:
- A VS Code Extension to make it easier to manage and develop Spark jobs on EMR☆39Updated 11 months ago
- 🐋 Docker image for AWS Glue Spark/Python☆23Updated 2 years ago
- A CLI to manage and monitor permissions in AWS Lake Formation☆25Updated 2 years ago
- Automated data quality suggestions and analysis with Deequ on AWS Glue☆90Updated 3 years ago
- Auto-generated Diagrams from Airflow DAGs. 🔮 🪄☆354Updated this week
- Soda Spark is a PySpark library that helps you with testing your data in Spark Dataframes☆63Updated 3 years ago
- 📆 Run, schedule, and manage your dbt jobs using Kubernetes.☆25Updated 7 years ago
- Spark runtime on AWS Lambda☆113Updated 4 months ago
- Superglue is a lineage-tracking tool built to help visualize the propagation of data through complex pipelines composed of tables, jobs …☆160Updated 3 years ago
- dbt (data build tool) projects targeting AWS analytics services (redshift, glue, emr, athena) and open table formats☆31Updated 2 years ago
- For a series of posts on Amazon MSK, Amazon EKS, and Amazon EMR☆67Updated 4 years ago
- Any Airflow project day 1, you can spin up a local desktop Kubernetes Airflow environment AND one in Google Cloud Composer with tested da…☆113Updated 2 years ago
- Faker for Snowflake!☆33Updated 3 years ago
- Example code for running Spark and Hive jobs on EMR Serverless.☆168Updated last year
- Utility functions for dbt projects running on Spark☆34Updated last month
- The open source version of the Amazon Redshift Cluster Management Guide.☆48Updated 2 years ago
- ☆201Updated 2 years ago
- A bunch of hacks developed around dbt☆48Updated 6 years ago
- Pylint plugin for static code analysis on Airflow code☆96Updated 5 years ago
- Benchmark data warehouses under Fivetran-like conditions☆172Updated 3 years ago
- Schema modelling framework for decentralised domain-driven ownership of data.☆260Updated 2 years ago
- Learn how to add data validation and documentation to a data pipeline built with dbt and Airflow.☆168Updated 2 years ago
- Sample configuration to deploy a modern data platform.☆89Updated 4 years ago
- Support for generating modern platforms dynamically with services such as Kafka, Spark, Streamsets, HDFS, ....☆78Updated this week
- The Picnic Data Vault framework.☆130Updated last week
- Build DataOps platform with Apache Airflow and dbt on AWS☆59Updated 4 years ago
- This repository contains the dbt-glue adapter☆139Updated 2 weeks ago
- Amazon Managed Workflows for Apache Airflow (MWAA) Examples repository contains example DAGs, requirements.txt, plugins, and CloudFormati…☆118Updated last month
- Trino dbt demo project to mix and load BigQuery data with and in a local PostgreSQL database☆76Updated 4 years ago
- ☆100Updated 2 years ago