run-ai / genvLinks
GPU environment and cluster management with LLM support
☆633Updated last year
Alternatives and similar repositories for genv
Users that are interested in genv are comparing it to the libraries listed below
Sorting:
- Module to Automatically maximize the utilization of GPU resources in a Kubernetes cluster through real-time dynamic partitioning and elas…☆667Updated last year
- ☆238Updated this week
- Module, Model, and Tensor Serialization/Deserialization☆260Updated 2 weeks ago
- A top-like tool for monitoring GPUs in a cluster☆85Updated last year
- ClearML Fractional GPU - Run multiple containers on the same GPU with driver level memory limitation ✨ and compute time-slicing☆79Updated last year
- TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and sup…☆387Updated this week
- KAI Scheduler is an open source Kubernetes Native scheduler for AI workloads at large scale☆782Updated this week
- PyTriton is a Flask/FastAPI-like interface that simplifies Triton's deployment in Python environments.☆817Updated 3 weeks ago
- CUDA checkpoint and restore utility☆365Updated 7 months ago
- Controller for ModelMesh☆238Updated 2 months ago
- Triton Model Navigator is an inference toolkit designed for optimizing and deploying Deep Learning models with a focus on NVIDIA GPUs.☆210Updated 4 months ago
- ☆279Updated 5 months ago
- MIG Partition Editor for NVIDIA GPUs☆209Updated this week
- Practical GPU Sharing Without Memory Size Constraints☆281Updated 5 months ago
- Distributed Model Serving Framework☆175Updated last week
- Where GPUs get cooked 👩🍳🔥☆279Updated 3 weeks ago
- NVIDIA Data Center GPU Manager (DCGM) is a project for gathering telemetry and measuring the health of NVIDIA GPUs☆568Updated 2 weeks ago
- ☆315Updated last year
- Container plugin for Slurm Workload Manager☆374Updated 2 weeks ago
- markdown docs☆91Updated last week
- Transform datasets at scale. Optimize datasets for fast AI model training.☆534Updated this week
- Triton Model Analyzer is a CLI tool to help with better understanding of the compute and memory requirements of the Triton Inference Serv…☆484Updated 3 weeks ago
- aim-mlflow integration☆219Updated 2 years ago
- Run Slurm in Kubernetes☆275Updated this week
- A simple yet powerful tool to turn traditional container/OS images into unprivileged sandboxes.☆813Updated this week
- Fault tolerance for PyTorch (HSDP, LocalSGD, DiLoCo, Streaming DiLoCo)☆392Updated this week
- GPUd automates monitoring, diagnostics, and issue identification for GPUs☆415Updated last week
- 🏋️ A unified multi-backend utility for benchmarking Transformers, Timm, PEFT, Diffusers and Sentence-Transformers with full support of O…☆310Updated 2 weeks ago
- RayLLM - LLMs on Ray (Archived). Read README for more info.☆1,263Updated 5 months ago
- NVIDIA NCCL Tests for Distributed Training☆110Updated this week