jrderuiter / airflow-fsLinks
Composable filesystem hooks and operators for Apache Airflow.
☆17Updated 4 years ago
Alternatives and similar repositories for airflow-fs
Users that are interested in airflow-fs are comparing it to the libraries listed below
Sorting:
- Data validation library for PySpark 3.0.0☆33Updated 2 years ago
- Pylint plugin for static code analysis on Airflow code☆96Updated 4 years ago
- scaffold of Apache Airflow executing Docker containers☆86Updated 2 years ago
- A Getting Started Guide for developing and using Airflow Plugins☆93Updated 6 years ago
- Airflow code accompanying blog post.☆21Updated 6 years ago
- Fast iterative local development and testing of Apache Airflow workflows☆201Updated last month
- REST-like API exposing Airflow data and operations☆61Updated 6 years ago
- Airflow Unit Tests and Integration Tests☆260Updated 2 years ago
- ☆23Updated 4 years ago
- Airflow workflow management platform chef cookbook.☆71Updated 6 years ago
- Builds Airflow DAGs from configuration files. Powers all DAGs on the Etsy Data Platform☆260Updated 2 years ago
- Airflow declarative DAGs via YAML☆133Updated 2 years ago
- pytest plugin to run the tests with support of pyspark☆87Updated 4 months ago
- Airflow plugin to transfer arbitrary files between operators☆78Updated 6 years ago
- Apache (Py)Spark type annotations (stub files).☆117Updated 3 years ago
- Helpers & syntactic sugar for PySpark.☆62Updated 2 years ago
- Visualize dependencies between Airflow DAGs☆49Updated 4 years ago
- Quickly get a kubernetes executor airflow environment provisioned on GKE. Azure Kubernetes Service instructions included also as are inst…☆36Updated 5 years ago
- Lightweight configuration and access to multiple databases in a single project☆38Updated last year
- Read Delta tables without any Spark☆47Updated last year
- Astronomer Core Docker Images☆106Updated last year
- ☆201Updated last year
- locopy: Loading/Unloading to Redshift and Snowflake using Python.☆113Updated 2 months ago
- triggering a DAG run multiple times☆88Updated last year
- Python client for Marquez☆12Updated 4 years ago
- Soda Spark is a PySpark library that helps you with testing your data in Spark Dataframes☆64Updated 3 years ago
- A repository of sample code to show data quality checking best practices using Airflow.☆78Updated 2 years ago
- PySpark phonetic and string matching algorithms☆39Updated last year
- Great Expectations Airflow operator☆167Updated last week
- Build and deploy a serverless data pipeline on AWS with no effort.☆111Updated 2 years ago