run-ai / genv
GPU environment and cluster management with LLM support
☆599Updated 10 months ago
Alternatives and similar repositories for genv:
Users that are interested in genv are comparing it to the libraries listed below
- Module to Automatically maximize the utilization of GPU resources in a Kubernetes cluster through real-time dynamic partitioning and elas…☆655Updated 11 months ago
- A top-like tool for monitoring GPUs in a cluster☆86Updated last year
- TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and sup…☆358Updated last week
- ☆190Updated last week
- PyTriton is a Flask/FastAPI-like interface that simplifies Triton's deployment in Python environments.☆785Updated 2 months ago
- CUDA checkpoint and restore utility☆322Updated 2 months ago
- Transform datasets at scale. Optimize datasets for fast AI model training.☆447Updated this week
- MIG Partition Editor for NVIDIA GPUs☆193Updated this week
- KAI Scheduler is an open source Kubernetes Native scheduler for AI workloads at large scale☆450Updated this week
- A simple yet powerful tool to turn traditional container/OS images into unprivileged sandboxes.☆725Updated 3 months ago
- ClearML Fractional GPU - Run multiple containers on the same GPU with driver level memory limitation ✨ and compute time-slicing☆76Updated 8 months ago
- ☆301Updated 7 months ago
- Triton Model Navigator is an inference toolkit designed for optimizing and deploying Deep Learning models with a focus on NVIDIA GPUs.☆199Updated 3 months ago
- Container plugin for Slurm Workload Manager☆334Updated 5 months ago
- Practical GPU Sharing Without Memory Size Constraints☆261Updated 2 weeks ago
- markdown docs☆85Updated this week
- NVIDIA Data Center GPU Manager (DCGM) is a project for gathering telemetry and measuring the health of NVIDIA GPUs☆492Updated last month
- Distributed Model Serving Framework☆162Updated last month
- Controller for ModelMesh☆227Updated 3 weeks ago
- Module, Model, and Tensor Serialization/Deserialization☆221Updated last month
- Tools for building GPU clusters☆1,331Updated this week
- GPUd automates monitoring, diagnostics, and issue identification for GPUs☆339Updated this week
- Dynamic Resource Allocation (DRA) for NVIDIA GPUs in Kubernetes☆341Updated this week
- User documentation for KServe.☆106Updated this week
- Kubernetes Operator, ansible playbooks, and production scripts for large-scale AIStore deployments on Kubernetes.☆92Updated this week
- Pipeline Parallelism for PyTorch☆762Updated 7 months ago
- A library to analyze PyTorch traces.☆366Updated this week
- Triton Model Analyzer is a CLI tool to help with better understanding of the compute and memory requirements of the Triton Inference Serv…☆470Updated last month
- An open-source efficient deep learning framework/compiler, written in python.☆692Updated last month
- GPU plugin to the node feature discovery for Kubernetes☆300Updated 10 months ago