ploomber / soopervisor
☁️ Export Ploomber pipelines to Kubernetes (Argo), Airflow, AWS Batch, SLURM, and Kubeflow.
☆45Updated last week
Alternatives and similar repositories for soopervisor:
Users that are interested in soopervisor are comparing it to the libraries listed below
- Convert monolithic Jupyter notebooks 📙 into maintainable Ploomber pipelines. 📊☆78Updated 6 months ago
- Automated Jupyter notebook testing. 📙☆41Updated last year
- Magniv Core - A Python-decorator based job orchestration platform. Avoid responsibility handoffs by abstracting infra and DevOps.☆78Updated 8 months ago
- 🚀 Stream inferences of real-time ML models in production to any data lake (Experimental)☆80Updated 2 years ago
- Ray provider for Apache Airflow☆47Updated last year
- Distributed Task Queue based Dask☆38Updated last year
- Machine Learning Projects with Flytekit☆35Updated last year
- A library to use `modal` as a backend for `joblib`.☆28Updated 2 months ago
- Unified Distributed Execution☆51Updated 4 months ago
- ☆29Updated last year
- Kedro Plugin to support running workflows on Kubeflow Pipelines☆53Updated 6 months ago
- Projects developed by Domino's R&D team☆76Updated 2 years ago
- Execute code snippets in markdown files.☆26Updated 2 months ago
- IbisML is a library for building scalable ML pipelines using Ibis.☆104Updated 2 months ago
- ☆17Updated last year
- Metadata store for Production ML☆89Updated 2 years ago
- Cloud provider cluster managers for Dask. Supports AWS, Google Cloud Azure and more...☆139Updated last month
- A software engineering framework to jump start your machine learning projects☆37Updated 9 months ago
- An abstraction layer for parameter tuning☆35Updated 6 months ago
- A toolbox 🧰 for Jupyter notebooks 📙: testing, experiment tracking, debugging, profiling, and more!☆68Updated 6 months ago
- ☆30Updated 3 years ago
- ForML - A development framework and MLOps platform for the lifecycle management of data science projects☆105Updated last year
- Ray-based Apache Beam runner☆43Updated last year
- mlctl is the control plane for MLOps. It provides a CLI and a Python SDK for supporting key operations related to MLOps, such as "model t…☆25Updated 3 years ago
- Batteries included toolkit for data engineering.☆33Updated 2 months ago
- Documentation and resources for deploying JupyterHub on Hadoop☆18Updated 5 years ago
- A Delta Lake reader for Dask☆49Updated 5 months ago
- Runnable☆39Updated this week
- Repository for makeinga a GitHub Actions for deploying to Kubeflow.☆35Updated 3 years ago
- 🐾 PdpCLI is a pandas DataFrame processing CLI tool which enables you to build a pandas pipeline from a configuration file.☆15Updated last year