kserve / open-inference-protocolLinks
Repository for open inference protocol specification
☆59Updated 5 months ago
Alternatives and similar repositories for open-inference-protocol
Users that are interested in open-inference-protocol are comparing it to the libraries listed below
Sorting:
- Controller for ModelMesh☆237Updated 4 months ago
- User documentation for KServe.☆108Updated last week
- Distributed Model Serving Framework☆177Updated 3 weeks ago
- Model Registry provides a single pane of glass for ML model developers to index and manage models, versions, and ML artifacts metadata. I…☆149Updated this week
- An Operator for deployment and maintenance of NVIDIA NIMs and NeMo microservices in a Kubernetes environment.☆130Updated last week
- Kubernetes Operator, ansible playbooks, and production scripts for large-scale AIStore deployments on Kubernetes.☆110Updated last week
- A curated list of awesome projects and resources related to Kubeflow (a CNCF incubating project)☆217Updated 2 months ago
- Unified runtime-adapter image of the sidecar containers which run in the modelmesh pods☆22Updated 4 months ago
- Kubeflow Pipelines on Tekton☆181Updated 11 months ago
- GenAI inference performance benchmarking tool☆106Updated last week
- Helm charts for llm-d☆50Updated 3 months ago
- Helm charts for the KubeRay project☆52Updated 3 months ago
- ☆258Updated last week
- JobSet: a k8s native API for distributed ML training and HPC workloads☆268Updated last week
- Fybrik☆132Updated last month
- WG Serving☆30Updated last week
- A collection of YAML files, Helm Charts, Operator code, and guides to act as an example reference implementation for NVIDIA NIM deploymen…☆196Updated this week
- kfctl is a CLI for deploying and managing Kubeflow☆184Updated 2 years ago
- Argoflow has been superseded by deployKF☆136Updated 2 years ago
- Prepare requirements and deploy Flyte using Helm☆79Updated 6 months ago
- A top-like tool for monitoring GPUs in a cluster☆85Updated last year
- ☆37Updated last week
- A lightweight tool to get an AI Infrastructure Stack up in minutes not days. K3ai will take care of setup K8s for You, deploy the AI tool…☆124Updated 3 years ago
- KServe models web UI☆38Updated last week
- K8s device plugin for GPU sharing☆99Updated 2 years ago
- ☆175Updated last week
- Kubeflow SDK for ML Experience☆36Updated last week
- InstaSlice facilitates the use of Dynamic Resource Allocation (DRA) on Kubernetes clusters for GPU sharing☆30Updated 11 months ago
- A toolkit for discovering cluster network topology.☆74Updated this week
- KAI Scheduler is an open source Kubernetes Native scheduler for AI workloads at large scale☆869Updated this week