NVIDIA / ais-k8s
Kubernetes Operator, ansible playbooks, and production scripts for large-scale AIStore deployments on Kubernetes.
☆94Updated this week
Alternatives and similar repositories for ais-k8s:
Users that are interested in ais-k8s are comparing it to the libraries listed below
- Run cloud native workloads on NVIDIA GPUs☆168Updated 2 weeks ago
- knavigator is a development, testing, and optimization toolkit for AI/ML scheduling systems at scale on Kubernetes.☆66Updated this week
- An Operator for deployment and maintenance of NVIDIA NIMs and NeMo microservices in a Kubernetes environment.☆100Updated this week
- Holistic job manager on Kubernetes☆115Updated last year
- The NVIDIA GPU driver container allows the provisioning of the NVIDIA driver through the use of containers.☆110Updated last week
- A Topology-Aware Custom Scheduler For Kubernetes☆64Updated last year
- Repository for open inference protocol specification☆54Updated 9 months ago
- JobSet: a k8s native API for distributed ML training and HPC workloads☆225Updated last week
- ☆24Updated this week
- GPU plugin to the node feature discovery for Kubernetes☆300Updated 11 months ago
- Run Slurm on Kubernetes. A Slinky project.☆86Updated last week
- A Slurm cluster for Kubernetes☆57Updated 9 months ago
- ☆62Updated this week
- AWS virtual gpu device plugin provides capability to use smaller virtual gpus for your machine learning inference workloads☆204Updated last year
- NVIDIA Network Operator☆247Updated this week
- K8s device plugin for GPU sharing☆100Updated 2 years ago
- ☆111Updated this week
- Dynamic Resource Allocation (DRA) for NVIDIA GPUs in Kubernetes☆353Updated this week
- MIG Partition Editor for NVIDIA GPUs☆198Updated this week
- Device plugins for Volcano, e.g. GPU☆119Updated last month
- Controller for ModelMesh☆229Updated last month
- GenAI inference performance benchmarking tool☆41Updated this week
- NVIDIA NCCL Tests for Distributed Training☆89Updated this week
- Fork of NVIDIA device plugin for Kubernetes with support for shared GPUs by declaring GPUs multiple times☆88Updated 2 years ago
- Provides for deploying custom ETL containers on AIStore, with subsequent user-defined extraction-transformation-loading in parallel, on t…☆16Updated this week
- Module, Model, and Tensor Serialization/Deserialization☆225Updated 2 months ago
- Run Slurm in Kubernetes☆220Updated this week
- Getting Started with the CoreWeave Kubernetes GPU Cloud☆70Updated last month
- A toolkit for discovering cluster network topology.☆46Updated last week
- Distributed Model Serving Framework☆165Updated last month