kserve / open-inference-protocol
Repository for open inference protocol specification
☆42Updated 3 months ago
Related projects ⓘ
Alternatives and complementary repositories for open-inference-protocol
- User documentation for KServe.☆105Updated this week
- Controller for ModelMesh☆203Updated 3 months ago
- ☆84Updated this week
- JobSet: a k8s native API for distributed ML training and HPC workloads☆143Updated this week
- LeaderWorkerSet: An API for deploying a group of pods as a unit of replication☆130Updated this week
- ☆50Updated this week
- Distributed Model Serving Framework☆154Updated 3 weeks ago
- A curated list of awesome projects and resources related to Kubeflow (a CNCF incubating project)☆194Updated 3 months ago
- An Operator for deployment and maintenance of NVIDIA NIMs and NeMo microservices in a Kubernetes environment.☆50Updated this week
- Kubernetes Operator, ansible playbooks, and production scripts for large-scale AIStore deployments on Kubernetes.☆74Updated 2 weeks ago
- kfctl is a CLI for deploying and managing Kubeflow☆181Updated last year
- Kubeflow Pipelines on Tekton☆173Updated last week
- K8s device plugin for GPU sharing☆96Updated last year
- Argoflow has been superseded by deployKF☆137Updated last year
- Dynamic Resource Allocation (DRA) for NVIDIA GPUs in Kubernetes☆259Updated this week
- MLOps Python Library☆116Updated 2 years ago
- Unified runtime-adapter image of the sidecar containers which run in the modelmesh pods☆21Updated last month
- LLM Instance gateway implementation.☆64Updated this week
- Holistic job manager on Kubernetes☆108Updated 8 months ago
- A lightweight tool to get an AI Infrastructure Stack up in minutes not days. K3ai will take care of setup K8s for You, deploy the AI tool…☆123Updated 2 years ago
- MLFlow Deployment Plugin for Ray Serve☆42Updated 2 years ago
- Kubernetes Operator for MPI-based applications (distributed training, HPC, etc.)☆440Updated 3 weeks ago
- Fybrik☆131Updated last year
- KServe models web UI☆34Updated last month
- KubeFlow on AWS☆170Updated 2 weeks ago
- elastic-gpu-scheduler is a Kubernetes scheduler extender for GPU resources scheduling.☆135Updated last year
- AWS virtual gpu device plugin provides capability to use smaller virtual gpus for your machine learning inference workloads☆202Updated 11 months ago
- Unified specification for defining and executing ML workflows, making reproducibility, consistency, and governance easier across the ML p…☆89Updated 7 months ago
- A top-like tool for monitoring GPUs in a cluster☆80Updated 8 months ago