kserve / modelmesh-servingLinks
Controller for ModelMesh
☆230Updated 3 weeks ago
Alternatives and similar repositories for modelmesh-serving
Users that are interested in modelmesh-serving are comparing it to the libraries listed below
Sorting:
- Distributed Model Serving Framework☆168Updated 3 weeks ago
- User documentation for KServe.☆106Updated this week
- Model Registry provides a single pane of glass for ML model developers to index and manage models, versions, and ML artifacts metadata. I…☆126Updated this week
- Kubeflow Pipelines on Tekton☆182Updated 6 months ago
- LeaderWorkerSet: An API for deploying a group of pods as a unit of replication☆457Updated this week
- Dynamic Resource Allocation (DRA) for NVIDIA GPUs in Kubernetes☆363Updated this week
- JobSet: a k8s native API for distributed ML training and HPC workloads☆229Updated this week
- Gateway API Inference Extension☆304Updated this week
- Repository for open inference protocol specification☆56Updated 3 weeks ago
- GPU plugin to the node feature discovery for Kubernetes☆300Updated last year
- KServe models web UI☆38Updated this week
- Kubernetes Operator for MPI-based applications (distributed training, HPC, etc.)☆480Updated 2 weeks ago
- A curated list of awesome projects and resources related to Kubeflow (a CNCF incubating project)☆209Updated last month
- Triton Model Navigator is an inference toolkit designed for optimizing and deploying Deep Learning models with a focus on NVIDIA GPUs.☆202Updated last month
- KAI Scheduler is an open source Kubernetes Native scheduler for AI workloads at large scale☆590Updated this week
- AWS virtual gpu device plugin provides capability to use smaller virtual gpus for your machine learning inference workloads☆204Updated last year
- An Operator for deployment and maintenance of NVIDIA NIMs and NeMo microservices in a Kubernetes environment.☆107Updated this week
- MIG Partition Editor for NVIDIA GPUs☆198Updated 2 weeks ago
- Holistic job manager on Kubernetes☆115Updated last year
- A top-like tool for monitoring GPUs in a cluster☆85Updated last year
- deployKF builds machine learning platforms on Kubernetes. We combine the best of Kubeflow, Airflow†, and MLflow† into a complete platform…☆434Updated 10 months ago
- Fork of NVIDIA device plugin for Kubernetes with support for shared GPUs by declaring GPUs multiple times☆88Updated 2 years ago
- Common APIs and libraries shared by other Kubeflow operator repositories.☆52Updated 2 years ago
- GenAI inference performance benchmarking tool☆44Updated this week
- Device plugins for Volcano, e.g. GPU☆121Updated 2 months ago
- Docker for Your ML/DL Models Based on OCI Artifacts☆467Updated last year
- ☆152Updated this week
- Unified runtime-adapter image of the sidecar containers which run in the modelmesh pods☆21Updated 3 weeks ago
- Kubernetes Operator for AI and Bigdata Elastic Training☆85Updated 4 months ago
- markdown docs☆88Updated last week