kubernetes-sigs / inference-perfLinks
GenAI inference performance benchmarking tool
☆44Updated this week
Alternatives and similar repositories for inference-perf
Users that are interested in inference-perf are comparing it to the libraries listed below
Sorting:
- Example DRA driver that developers can fork and modify to get them started writing their own.☆73Updated last week
- WG Serving☆25Updated last month
- knavigator is a development, testing, and optimization toolkit for AI/ML scheduling systems at scale on Kubernetes.☆67Updated 3 weeks ago
- JobSet: a k8s native API for distributed ML training and HPC workloads☆229Updated this week
- Gateway API Inference Extension☆304Updated this week
- Cloud Native Artifacial Intelligence Model Format Specification☆49Updated last week
- ☆152Updated this week
- Holistic job manager on Kubernetes☆115Updated last year
- Kubernetes Work API☆66Updated 3 weeks ago
- Libraries for implementing aggregated apiservers☆89Updated last month
- Inference scheduler for llm-d☆41Updated this week
- An Operator for deployment and maintenance of NVIDIA NIMs and NeMo microservices in a Kubernetes environment.☆103Updated this week
- ☆37Updated this week
- Enabling Kubernetes to make pod placement decisions with platform intelligence.☆176Updated 4 months ago
- 🧯 Kubernetes coverage for fault awareness and recovery, works for any LLMOps, MLOps, AI workloads.☆30Updated 5 months ago
- InstaSlice Operator facilitates slicing of accelerators using stable APIs☆35Updated this week
- Operator for managing Node Feature Discovery deployment☆70Updated 2 months ago
- All the things to make the scheduler extendable with wasm.☆120Updated last week
- ☆11Updated last month
- ☆51Updated last year
- 🏃🏿♀️🏃🏽♀️🏃🏻♂️🕒CNCF Technical Advisory Group for Runtime☆94Updated last month
- A toolkit for discovering cluster network topology.☆50Updated last week
- CNI DRA Driver☆25Updated 4 months ago
- hub / spoke registration controllers☆42Updated 7 months ago
- The main purpose of runtime copilot is to assist with node runtime management tasks such as configuring registries, upgrading versions, i…☆12Updated 2 years ago
- ☆115Updated 2 years ago
- ☆112Updated 3 weeks ago
- The kernel module management operator builds, signs and loads kernel modules in Kubernetes clusters.☆101Updated this week
- CAPK is a provider for Cluster API (CAPI) that allows users to deploy fake, Kubemark-backed machines to their clusters.☆74Updated this week
- InstaSlice facilitates the use of Dynamic Resource Allocation (DRA) on Kubernetes clusters for GPU sharing☆27Updated 6 months ago