llm-d / llm-d-model-serviceLinks
Simplified model deployment on llm-d
☆18Updated this week
Alternatives and similar repositories for llm-d-model-service
Users that are interested in llm-d-model-service are comparing it to the libraries listed below
Sorting:
- Inference scheduler for llm-d☆41Updated this week
- InstaSlice Operator facilitates slicing of accelerators using stable APIs☆35Updated this week
- open-cluster-management governance material.☆64Updated 2 months ago
- Example DRA driver that developers can fork and modify to get them started writing their own.☆73Updated last week
- ☆55Updated this week
- hub / spoke registration controllers☆42Updated 7 months ago
- Minimum cluster registration and work☆58Updated 8 months ago
- A template project for writing your own controller using the Knative helper libraries.☆73Updated 2 weeks ago
- Holistic job manager on Kubernetes☆115Updated last year
- RukPak runs in a Kubernetes cluster and defines APIs for installing cloud native content☆51Updated 9 months ago
- command line tool to bootstrap open-cluster-management control plane.☆89Updated last week
- ☆88Updated this week
- GenAI inference performance benchmarking tool☆44Updated this week
- Kubernetes Work API☆66Updated 3 weeks ago
- Helpers for going from apis and clients to useful runtime constructs☆100Updated 2 weeks ago
- Model Registry provides a single pane of glass for ML model developers to index and manage models, versions, and ML artifacts metadata. I…☆126Updated last week
- Container Object Storage Interface (COSI) provisioner responsible to interface with COSI drivers. NOTE: The content of this repo has bee…☆34Updated 6 months ago
- Repository to demo GPU Sharing with Time Slicing, MPS, MIG and others☆41Updated 7 months ago
- Enables multicluster application delivery.☆45Updated 3 weeks ago
- Operator for monitoring liveness of Routes and URL's on OpenShift☆33Updated 3 weeks ago
- Distributed KV cache coordinator☆31Updated last week
- Core APIs for open cluster management☆257Updated this week
- Operator for local storage☆93Updated 3 weeks ago
- CSI driver to bootstrap COSI workloads☆18Updated 2 years ago
- A benchmarking tool to evaluate Knative performance☆38Updated last year
- Managing the lifecycle for a group of operands☆34Updated last week
- Container Object Storage Interface (COSI) API responsible to define API for COSI objects. NOTE: The content of this repo has been moved t…☆70Updated 6 months ago
- An operator to run descheduler on OpenShift.☆53Updated this week
- This repo contains sidecar controller and agent for volume health monitoring.☆67Updated last week
- The Observatorium API☆56Updated last week