BasPH / airflow-rocketLinks
Airflow code accompanying blog post.
☆21Updated 6 years ago
Alternatives and similar repositories for airflow-rocket
Users that are interested in airflow-rocket are comparing it to the libraries listed below
Sorting:
- Composable filesystem hooks and operators for Apache Airflow.☆17Updated 4 years ago
- scaffold of Apache Airflow executing Docker containers☆86Updated 2 years ago
- Airflow plugin to transfer arbitrary files between operators☆78Updated 6 years ago
- An example PySpark project with pytest☆16Updated 7 years ago
- A Getting Started Guide for developing and using Airflow Plugins☆93Updated 6 years ago
- Pylint plugin for static code analysis on Airflow code☆95Updated 4 years ago
- Airflow workflow management platform chef cookbook.☆71Updated 6 years ago
- Airflow declarative DAGs via YAML☆133Updated last year
- Data validation library for PySpark 3.0.0☆33Updated 2 years ago
- 🐍💨 Airflow tutorial for PyCon 2019☆85Updated 2 years ago
- The sane way of building a data layer in Airflow☆24Updated 5 years ago
- CLI tool to launch Spark jobs on AWS EMR☆67Updated last year
- This repo demonstrates how to load a sample Parquet formatted file from an AWS S3 Bucket. A python job will then be submitted to a Apach…☆19Updated 9 years ago
- ☆11Updated 8 months ago
- Uses Cloud Build to deploy a scalable batch ingestion pipeline consisting of GCS, Cloud Functions, Dataflow and BigQuery☆22Updated 2 years ago
- Asynchronous actions for PySpark☆47Updated 3 years ago
- A pyspark lib to validate data quality☆18Updated 2 years ago
- Metadata service library for Amundsen☆83Updated 3 weeks ago
- Airflow configuration for Telemetry☆192Updated last week
- An extension for Jupyter notebooks that allows running notebooks inside a Docker container and converting them to runnable Docker images.☆28Updated last year
- Quickly get a kubernetes executor airflow environment provisioned on GKE. Azure Kubernetes Service instructions included also as are inst…☆36Updated 5 years ago
- Airflow Unit Tests and Integration Tests☆260Updated 2 years ago
- pytest plugin to run the tests with support of pyspark☆86Updated 2 months ago
- ☕⛵WIP PySpark dependency management☆22Updated 7 years ago
- ☆59Updated 3 years ago
- An ML project template with sensible defaults☆37Updated 3 years ago
- Example unit tests for Apache Spark Python scripts using the py.test framework☆84Updated 9 years ago
- Apache Airflow CI pipeline☆19Updated 6 years ago
- ☆200Updated last year
- Functional Airflow DAG definitions.☆38Updated 8 years ago