GPU environment and cluster management with LLM support
☆658May 16, 2024Updated 2 years ago
Alternatives and similar repositories for genv
Users that are interested in genv are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A top-like tool for monitoring GPUs in a cluster☆84Feb 14, 2024Updated 2 years ago
- GPU Environment Management for Visual Studio Code☆39Jul 19, 2023Updated 3 years ago
- Translation layer that maps any Kubernetes framework's Custom Resource Definitions (CRDs) into a standardized, generic structure.☆87Updated this week
- ☆401Updated this week
- GPU Environment Management for JupyterLab☆26Feb 19, 2024Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- KAI Scheduler is an open source Kubernetes Native scheduler for AI workloads at large scale☆1,625Updated this week
- ☆341Oct 14, 2026Updated 2 weeks ago
- KAI Resource Management is an open source Kubernetes-native resource management layer for KAI Scheduler, adding projects, departments, no…☆46Updated this week
- Tensors, for human consumption☆1,399Apr 9, 2026Updated 6 months ago
- DRA Driver for NVIDIA GPUs☆726Updated this week
- Kubernetes enhancements for Network Topology Aware Gang Scheduling & Autoscaling☆285Updated this week
- A transparent, in-container GPU resource controller that enforces memory and compute limits by intercepting CUDA calls without applicatio…☆347Oct 26, 2026Updated last week
- A unified orchestration layer for heterogeneous AI compute. It standardizes how to manage compute and run training and inference on GPU c…☆2,298Updated this week
- ☆816Oct 20, 2026Updated last week
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ClearML Fractional GPU - Run multiple containers on the same GPU with driver level memory limitation ✨ and compute time-slicing☆97Mar 12, 2026Updated 7 months ago
- Node-level enforcement and metrics for fractional GPU allocations made by KAI Scheduler.☆52Oct 26, 2026Updated last week
- The AI Compute Platform for frontier teams. SkyPilot turns fragmented AI compute into one AI supercomputer, so frontier AI teams build cu…☆10,777Updated this week
- elastic-gpu-scheduler is a Kubernetes scheduler extender for GPU resources scheduling.☆147Nov 21, 2022Updated 3 years ago
- GPUd automates monitoring, diagnostics, and issue identification for GPUs☆498Updated this week
- Practical GPU Sharing Without Memory Size Constraints☆318Mar 28, 2025Updated last year
- Module to Automatically maximize the utilization of GPU resources in a Kubernetes cluster through real-time dynamic partitioning and elas…☆688Apr 21, 2024Updated 2 years ago
- Snapshot gets GPU pods ready in seconds instead of minutes — by restoring a fully initialized GPU worker instead of starting one from scr…☆76Updated this week
- NVIDIA GPU Operator creates, configures, and manages GPUs in Kubernetes☆2,961Updated this week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Heterogeneous GPU Sharing on Kubernetes☆5,072Updated this week
- Tools for building GPU clusters☆1,483Updated this week
- Module, Model, and Tensor Serialization/Deserialization☆328Jul 7, 2026Updated 3 months ago
- LeaderWorkerSet & DisaggregatedSet: Kubernetes APIs for Distributed and Disaggregated AI Serving☆898Updated this week
- GPU plugin to the node feature discovery for Kubernetes☆308May 27, 2024Updated 2 years ago
- A Datacenter Scale Distributed Inference Serving Framework☆8,416Updated this week
- NVIDIA Network Operator☆378Updated this week
- Kubernetes Operator for MPI-based applications (distributed training, HPC, etc.)☆540Oct 26, 2026Updated last week
- A JupyterLab extension for displaying dashboards of GPU usage.☆680Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A toolkit to run Ray applications on Kubernetes☆2,755Updated this week
- Determined is an open-source machine learning platform that simplifies distributed training, hyperparameter tuning, experiment tracking, …☆3,244Mar 20, 2025Updated last year
- Supercharge Your Model Training☆5,508Apr 29, 2026Updated 6 months ago
- The Triton Inference Server provides an optimized cloud and edge inferencing solution.☆11,122Updated this week
- NVIDIA device plugin for Kubernetes☆3,913Updated this week
- The NVIDIA Driver Manager is a Kubernetes component which assist in seamless upgrades of NVIDIA Driver on each node of the cluster.☆55Updated this week
- NVIDIA vGPU Device Manager manages NVIDIA vGPU devices on top of Kubernetes☆170Updated this week