leptonai / gpudLinks
GPUd automates monitoring, diagnostics, and issue identification for GPUs
☆375Updated this week
Alternatives and similar repositories for gpud
Users that are interested in gpud are comparing it to the libraries listed below
Sorting:
- KV cache store for distributed LLM inference☆261Updated 2 weeks ago
- CUDA checkpoint and restore utility☆345Updated 4 months ago
- NVIDIA NCCL Tests for Distributed Training☆97Updated this week
- NVIDIA Inference Xfer Library (NIXL)☆413Updated this week
- ☆310Updated 10 months ago
- A kubernetes plugin which enables dynamically add or remove GPU resources for a running Pod☆125Updated 3 years ago
- Efficient and easy multi-instance LLM serving☆437Updated this week
- Kubernetes Operator for AI and Bigdata Elastic Training☆86Updated 5 months ago
- ☆270Updated this week
- NVIDIA Data Center GPU Manager (DCGM) is a project for gathering telemetry and measuring the health of NVIDIA GPUs☆525Updated last month
- HAMi-core compiles libvgpu.so, which ensures hard limit on GPU in container☆171Updated this week
- LeaderWorkerSet: An API for deploying a group of pods as a unit of replication☆486Updated this week
- Device plugins for Volcano, e.g. GPU☆124Updated 3 months ago
- elastic-gpu-scheduler is a Kubernetes scheduler extender for GPU resources scheduling.☆141Updated 2 years ago
- Dynamic Resource Allocation (DRA) for NVIDIA GPUs in Kubernetes☆374Updated this week
- ☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!☆204Updated this week
- MIG Partition Editor for NVIDIA GPUs☆201Updated last week
- ☆532Updated last year
- ☆221Updated this week
- RDMA and SHARP plugins for nccl library☆195Updated last week
- cricket is a virtualization solution for GPUs☆201Updated 2 weeks ago
- GLake: optimizing GPU memory management and IO transmission.☆467Updated 2 months ago
- Using CRDs to manage GPU resources in Kubernetes.☆200Updated 2 years ago
- NVIDIA Resiliency Extension is a python package for framework developers and users to implement fault-tolerant features. It improves the …☆177Updated 2 weeks ago
- Device-plugin for volcano vgpu which support hard resource isolation☆89Updated 2 weeks ago
- Golang bindings for Nvidia Datacenter GPU Manager (DCGM)☆116Updated 2 months ago
- A toolkit for discovering cluster network topology.☆54Updated last week
- NCCL Fast Socket is a transport layer plugin to improve NCCL collective communication performance on Google Cloud.☆116Updated last year
- ☆49Updated 3 months ago
- Go Abstraction for Allocating NVIDIA GPUs with Custom Policies☆113Updated this week