skillupco / airflow-valohai-pluginLinks
Airflow plugin to scale machine learning tasks with Valohai and get automatic version control
☆18Updated 2 years ago
Alternatives and similar repositories for airflow-valohai-plugin
Users that are interested in airflow-valohai-plugin are comparing it to the libraries listed below
Sorting:
- Fast iterative local development and testing of Apache Airflow workflows☆201Updated last month
- REST-like API exposing Airflow data and operations☆61Updated 6 years ago
- DBND is an agile pipeline framework that helps data engineering teams track and orchestrate their data processes.☆267Updated 5 months ago
- triggering a DAG run multiple times☆88Updated last year
- python automatic data quality check toolkit☆282Updated 5 years ago
- Builds Airflow DAGs from configuration files. Powers all DAGs on the Etsy Data Platform☆260Updated 2 years ago
- Airflow plugin to export dag and task based metrics to Prometheus.☆260Updated 3 months ago
- Amazon Redshift SQLAlchemy Dialect☆223Updated last year
- Machine learning operator & controller for Kubernetes☆93Updated 2 months ago
- Pylint plugin for static code analysis on Airflow code☆95Updated 4 years ago
- Tools for test driven data-wrangling and data validation.☆295Updated 3 years ago
- ☆201Updated last year
- Tough and flexible tools for data analysis, transformation, validation and movement.☆139Updated last year
- A plugin for Apache Airflow that exposes rest end points for the Command Line Interfaces☆326Updated 4 years ago
- Example DAGs using hooks and operators from Airflow Plugins☆347Updated 7 years ago
- Airflow plugin to transfer arbitrary files between operators☆78Updated 6 years ago
- Create HTML profiling reports from Apache Spark DataFrames☆196Updated 5 years ago
- Helpers & syntactic sugar for PySpark.☆62Updated 2 years ago
- Airflow Unit Tests and Integration Tests☆260Updated 2 years ago
- fast and scalable Airflow on Kubernetes Setup.☆28Updated 2 years ago
- Airflow declarative DAGs via YAML☆133Updated 2 years ago
- Official repository for pygrametl - ETL programming in Python☆296Updated last month
- A Helm chart to install Apache Airflow on Kubernetes☆286Updated this week
- pytest plugin to run the tests with support of pyspark☆87Updated 3 months ago
- Monitor Apache Spark from Jupyter Notebook☆172Updated 3 years ago
- Astronomer Core Docker Images☆107Updated last year
- Apache (Py)Spark type annotations (stub files).☆117Updated 3 years ago
- Data Orchestration Platform☆64Updated 4 years ago
- Docker image of Apache Spark with its Python interface, pyspark.☆40Updated 7 years ago
- Making DAG construction easier☆271Updated last week