kubernetes-sigs / llm-instance-gateway
LLM Instance gateway implementation.
☆18Updated this week
Related projects: ⓘ
- Example DRA driver that developers can fork and modify to get them started writing their own.☆46Updated this week
- ☸️ Easy, advanced inference platform for large language models on Kubernetes☆15Updated this week
- ☆43Updated 3 months ago
- ☆25Updated this week
- LeaderWorkerSet: An API for deploying a group of pods as a unit of replication☆121Updated this week
- Kubernetes Work API☆56Updated 3 weeks ago
- JobSet: a k8s native API for distributed ML training and HPC workloads☆133Updated this week
- Container Object Storage Interface (COSI) provisioner responsible to interface with COSI drivers.☆34Updated last month
- Operator for managing Node Feature Discovery deployment☆66Updated last month
- Behaviour driven reconciler testing framework.☆29Updated this week
- The main purpose of runtime copilot is to assist with node runtime management tasks such as configuring registries, upgrading versions, i…☆12Updated last year
- hub / spoke registration controllers☆42Updated last year
- 🏃🏿♀️🏃🏽♀️🏃🏻♂️🕒CNCF Technical Advisory Group for Runtime☆82Updated 2 weeks ago
- Container Object Storage Interface (COSI) API responsible to define API for COSI objects.☆62Updated 3 weeks ago
- A CRD for arbitrary properties about a cluster☆30Updated 2 months ago
- Installs and maintains the kube-scheduler on a cluster.☆34Updated this week
- This repo addresses further work involving Kubernetes network security beyond the initial NetworkPolicy resource☆52Updated last week
- Minimum cluster registration and work☆58Updated 9 months ago
- Manage kubernetes node-level kernel tuning ( using sysctl ).☆24Updated last year
- knavigator is a development, testing, and optimization toolkit for AI/ML scheduling systems at scale on Kubernetes.☆47Updated 3 weeks ago
- CAPK is a provider for Cluster API (CAPI) that allows users to deploy fake, Kubemark-backed machines to their clusters.☆61Updated this week
- Idle containers when not handling requests.☆41Updated last year
- Automatic repair for unhealthy Kubernetes nodes☆42Updated 2 months ago
- Container Object Storage Interface (COSI) controller responsible to manage lifecycle of COSI objects.☆91Updated last month
- Directly access data objects stored in etcd by Kubernetes.☆41Updated this week
- Kubernetes ClusterInventory API☆46Updated last month
- The kernel module management operator builds, signs and loads kernel modules in Kubernetes clusters.☆87Updated this week
- K8s Node Health Check Operator☆88Updated last month
- Kubernetes Operator to manage node maintenance through NodeMaintenance custom resources☆27Updated last week
- ☆46Updated 6 months ago