run-ai / genvLinks
GPU environment and cluster management with LLM support
☆654Updated last year
Alternatives and similar repositories for genv
Users that are interested in genv are comparing it to the libraries listed below
Sorting:
- Module to Automatically maximize the utilization of GPU resources in a Kubernetes cluster through real-time dynamic partitioning and elas…☆676Updated last year
- Module, Model, and Tensor Serialization/Deserialization☆276Updated 3 months ago
- A top-like tool for monitoring GPUs in a cluster☆85Updated last year
- ☆267Updated this week
- ClearML Fractional GPU - Run multiple containers on the same GPU with driver level memory limitation ✨ and compute time-slicing☆83Updated 2 weeks ago
- TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and sup…☆402Updated this week
- Triton Model Navigator is an inference toolkit designed for optimizing and deploying Deep Learning models with a focus on NVIDIA GPUs.☆213Updated 7 months ago
- Practical GPU Sharing Without Memory Size Constraints☆293Updated 8 months ago
- PyTriton is a Flask/FastAPI-like interface that simplifies Triton's deployment in Python environments.☆829Updated 3 months ago
- ☆316Updated last year
- Controller for ModelMesh☆241Updated 5 months ago
- MIG Partition Editor for NVIDIA GPUs☆230Updated this week
- ☆282Updated 8 months ago
- aim-mlflow integration☆224Updated 2 years ago
- Benchmark Suite for Deep Learning☆278Updated last month
- CUDA checkpoint and restore utility☆393Updated 2 months ago
- Distributed Model Serving Framework☆178Updated 2 months ago
- Triton Model Analyzer is a CLI tool to help with better understanding of the compute and memory requirements of the Triton Inference Serv…☆497Updated last week
- Where GPUs get cooked 👩🍳🔥☆319Updated 2 months ago
- markdown docs☆92Updated 3 weeks ago
- Fault tolerance for PyTorch (HSDP, LocalSGD, DiLoCo, Streaming DiLoCo)☆454Updated 2 weeks ago
- KAI Scheduler is an open source Kubernetes Native scheduler for AI workloads at large scale☆943Updated this week
- GPUd automates monitoring, diagnostics, and issue identification for GPUs☆455Updated this week
- NVIDIA Data Center GPU Manager (DCGM) is a project for gathering telemetry and measuring the health of NVIDIA GPUs☆621Updated last month
- Container plugin for Slurm Workload Manager☆398Updated 2 weeks ago
- ClearML - Model-Serving Orchestration and Repository Solution☆158Updated 3 weeks ago
- AIStore: scalable storage for AI applications☆1,643Updated this week
- Speed up model training by fixing data loading.☆561Updated this week
- Run Slurm in Kubernetes☆327Updated this week
- Tools for building GPU clusters☆1,402Updated 5 months ago