kubernetes-sigs / inference-perf
GenAI inference performance benchmarking tool
☆19Updated last week
Alternatives and similar repositories for inference-perf:
Users that are interested in inference-perf are comparing it to the libraries listed below
- Example DRA driver that developers can fork and modify to get them started writing their own.☆63Updated last week
- knavigator is a development, testing, and optimization toolkit for AI/ML scheduling systems at scale on Kubernetes.☆63Updated last week
- 🧯 Kubernetes coverage for fault awareness and recovery, works for any LLMOps, MLOps, AI workloads.☆28Updated 2 months ago
- The main purpose of runtime copilot is to assist with node runtime management tasks such as configuring registries, upgrading versions, i…☆12Updated last year
- WG Serving☆20Updated last month
- eXtThrottle - Extended resource quota controller and Admission Webhook for using GPU in kubernetes.☆17Updated 6 years ago
- Libraries for implementing aggregated apiservers☆87Updated last week
- Kubernetes Work API☆65Updated last month
- ☆34Updated this week
- ☆112Updated last week
- Gateway API Inference Extension☆179Updated this week
- Operator for managing Node Feature Discovery deployment☆68Updated last week
- ☆11Updated last week
- Holistic job manager on Kubernetes☆112Updated last year
- JobSet: a k8s native API for distributed ML training and HPC workloads☆194Updated last week
- 🏃🏿♀️🏃🏽♀️🏃🏻♂️🕒CNCF Technical Advisory Group for Runtime☆91Updated 3 months ago
- Cloud Native Artifacial Intelligence Model Format Specification☆31Updated last week
- ☆114Updated 2 years ago
- A simulator of Kuberntes for batch and service workload.☆45Updated 3 years ago
- CAPK is a provider for Cluster API (CAPI) that allows users to deploy fake, Kubemark-backed machines to their clusters.☆67Updated last week
- An Operator for deployment and maintenance of NVIDIA NIMs and NeMo microservices in a Kubernetes environment.☆88Updated last week
- Following the same workflows as Kubernetes.☆11Updated last week
- CNI DRA Driver☆22Updated 2 months ago
- Container Object Storage Interface (COSI) provisioner responsible to interface with COSI drivers. NOTE: The content of this repo has bee…☆34Updated 3 months ago
- hub / spoke registration controllers☆42Updated 5 months ago
- All the things to make the scheduler extendable with wasm.☆115Updated 2 months ago
- Resource Topology exporter for Topology Aware Scheduler☆15Updated 3 weeks ago
- A CRD for arbitrary properties about a cluster☆34Updated last month