GPU environment and cluster management with LLM support
☆658May 16, 2024Updated last year
Alternatives and similar repositories for genv
Users that are interested in genv are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A top-like tool for monitoring GPUs in a cluster☆84Feb 14, 2024Updated 2 years ago
- GPU Environment Management for Visual Studio Code☆39Jul 19, 2023Updated 2 years ago
- ☆290Mar 19, 2026Updated last week
- markdown docs☆95Feb 1, 2026Updated last month
- ☆232Updated this week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click and start building anything your business needs.
- KAI Scheduler is an open source Kubernetes Native scheduler for AI workloads at large scale☆1,191Updated this week
- GPU Environment Management for JupyterLab☆26Feb 19, 2024Updated 2 years ago
- Tensors, for human consumption☆1,363Mar 11, 2026Updated 2 weeks ago
- ClearML Fractional GPU - Run multiple containers on the same GPU with driver level memory limitation ✨ and compute time-slicing☆90Mar 12, 2026Updated 2 weeks ago
- Run, manage, and scale AI workloads on any AI infrastructure. Use one system to access & manage all AI compute (Kubernetes, Slurm, 20+ cl…☆9,664Updated this week
- ☆799Updated this week
- HAMi-core compiles libvgpu.so, which ensures hard limit on GPU in container☆282Feb 28, 2026Updated 3 weeks ago
- dstack is an open-source control plane for running development, training, and inference jobs on GPUs—across hyperscalers, neoclouds, or o…☆2,069Updated this week
- NVIDIA GPU Operator creates, configures, and manages GPUs in Kubernetes☆2,598Updated this week
- DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- A Datacenter Scale Distributed Inference Serving Framework☆6,347Mar 20, 2026Updated last week
- Practical GPU Sharing Without Memory Size Constraints☆306Mar 28, 2025Updated 11 months ago
- GPUd automates monitoring, diagnostics, and issue identification for GPUs☆479Updated this week
- NVIDIA DRA Driver for GPUs☆593Updated this week
- The NVIDIA Driver Manager is a Kubernetes component which assist in seamless upgrades of NVIDIA Driver on each node of the cluster.☆50Mar 17, 2026Updated last week
- GPU plugin to the node feature discovery for Kubernetes☆307May 27, 2024Updated last year
- An Envoy inspired, ultimate LLM-first gateway for LLM serving and downstream application developers and enterprises☆26Apr 24, 2025Updated 11 months ago
- A JupyterLab extension for displaying dashboards of GPU usage.☆669Feb 23, 2026Updated last month
- The Triton Inference Server provides an optimized cloud and edge inferencing solution.☆10,446Mar 20, 2026Updated last week
- NordVPN Special Discount Offer • AdSave on top-rated NordVPN 1 or 2-year plans with secure browsing, privacy protection, and support for for all major platforms.
- ☆12Aug 27, 2024Updated last year
- ☆195Jan 20, 2026Updated 2 months ago
- NVIDIA device plugin for Kubernetes☆3,706Updated this week
- LeaderWorkerSet: An API for deploying a group of pods as a unit of replication☆682Updated this week
- Tools for building GPU clusters☆1,424Feb 23, 2026Updated last month
- Simple, safe way to store and distribute tensors☆3,661Mar 17, 2026Updated last week
- Kubernetes Operator for MPI-based applications (distributed training, HPC, etc.)☆519Mar 19, 2026Updated last week
- elastic-gpu-scheduler is a Kubernetes scheduler extender for GPU resources scheduling.☆145Nov 21, 2022Updated 3 years ago
- Build and run containers leveraging NVIDIA GPUs☆4,181Updated this week
- DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- A high-throughput and memory-efficient inference and serving engine for LLMs☆74,135Updated this week
- A toolkit to run Ray applications on Kubernetes☆2,388Updated this week
- Python client for the Run:ai REST API☆24Dec 15, 2025Updated 3 months ago
- GPU Sharing Scheduler for Kubernetes Cluster☆1,531Dec 29, 2023Updated 2 years ago
- Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes☆5,257Updated this week
- Heterogeneous GPU Sharing on Kubernetes☆3,110Mar 19, 2026Updated last week
- Containers for machine learning☆9,274Updated this week