run-ai / genv
GPU environment and cluster management with LLM support
☆564Updated 8 months ago
Alternatives and similar repositories for genv:
Users that are interested in genv are comparing it to the libraries listed below
- Module to Automatically maximize the utilization of GPU resources in a Kubernetes cluster through real-time dynamic partitioning and elas…☆642Updated 9 months ago
- A top-like tool for monitoring GPUs in a cluster☆84Updated 11 months ago
- Module, Model, and Tensor Serialization/Deserialization☆210Updated 2 months ago
- ☆154Updated last week
- markdown docs☆75Updated this week
- PyTriton is a Flask/FastAPI-like interface that simplifies Triton's deployment in Python environments.☆765Updated 2 months ago
- ClearML Fractional GPU - Run multiple containers on the same GPU with driver level memory limitation ✨ and compute time-slicing☆70Updated 5 months ago
- Triton Model Navigator is an inference toolkit designed for optimizing and deploying Deep Learning models with a focus on NVIDIA GPUs.☆193Updated 2 weeks ago
- TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and sup…☆341Updated last week
- Triton Model Analyzer is a CLI tool to help with better understanding of the compute and memory requirements of the Triton Inference Serv…☆448Updated 2 weeks ago
- aim-mlflow integration☆197Updated last year
- Controller for ModelMesh☆215Updated 3 weeks ago
- ☆258Updated 2 months ago
- MIG Partition Editor for NVIDIA GPUs☆185Updated this week
- A library to analyze PyTorch traces.☆325Updated this week
- Practical GPU Sharing Without Memory Size Constraints☆237Updated 4 months ago
- GPU plugin to the node feature discovery for Kubernetes☆296Updated 8 months ago
- User documentation for KServe.☆104Updated last week
- Distributed Model Serving Framework☆157Updated 3 months ago
- ClearML - Model-Serving Orchestration and Repository Solution☆141Updated 2 weeks ago
- ☆294Updated 5 months ago
- Container plugin for Slurm Workload Manager☆314Updated 2 months ago
- NVIDIA GPU metrics exporter for Prometheus leveraging DCGM☆1,023Updated this week
- Dynamic Resource Allocation (DRA) for NVIDIA GPUs in Kubernetes☆305Updated this week
- Benchmark Suite for Deep Learning☆256Updated 3 weeks ago
- NVIDIA Data Center GPU Manager (DCGM) is a project for gathering telemetry and measuring the health of NVIDIA GPUs☆445Updated 3 weeks ago
- NVIDIA NCCL Tests for Distributed Training☆78Updated this week
- Model Deployment at Scale on Kubernetes 🦄️☆791Updated 8 months ago
- Kubernetes Operator, ansible playbooks, and production scripts for large-scale AIStore deployments on Kubernetes.☆88Updated last week