GPU environment and cluster management with LLM support
☆659May 16, 2024Updated 2 years ago
Alternatives and similar repositories for genv
Users that are interested in genv are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A top-like tool for monitoring GPUs in a cluster☆85Feb 14, 2024Updated 2 years ago
- GPU Environment Management for Visual Studio Code☆39Jul 19, 2023Updated 3 years ago
- Translation layer that maps any Kubernetes framework's Custom Resource Definitions (CRDs) into a standardized, generic structure.☆74Updated this week
- ☆382Updated this week
- KAI Scheduler is an open source Kubernetes Native scheduler for AI workloads at large scale☆1,525Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆320Updated this week
- Tensors, for human consumption☆1,395Apr 9, 2026Updated 5 months ago
- ClearML Fractional GPU - Run multiple containers on the same GPU with driver level memory limitation ✨ and compute time-slicing☆96Mar 12, 2026Updated 6 months ago
- ☆814Sep 9, 2026Updated last week
- The AI Compute Platform for frontier teams. SkyPilot turns fragmented AI compute into one AI supercomputer, so frontier AI teams build cu…☆10,621Updated this week
- Vendor-agnostic orchestration for training, inference and agentic workloads across NVIDIA, AMD, TPU, and Tenstorrent on clouds, Kubernete…☆2,253Updated this week
- DRA Driver for NVIDIA GPUs☆711Updated this week
- GPUd automates monitoring, diagnostics, and issue identification for GPUs☆496Updated this week
- Practical GPU Sharing Without Memory Size Constraints☆318Mar 28, 2025Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- A comprehensive Helm chart for monitoring GPU resources in Kubernetes clusters. This tool provides real-time visibility into GPU allocati…☆34Aug 26, 2026Updated 3 weeks ago
- NVIDIA GPU Operator creates, configures, and manages GPUs in Kubernetes☆2,879Updated this week
- Kubernetes enhancements for Network Topology Aware Gang Scheduling & Autoscaling☆268Updated this week
- A transparent, in-container GPU resource controller that enforces memory and compute limits by intercepting CUDA calls without applicatio…☆334Updated this week
- A Datacenter Scale Distributed Inference Serving Framework☆8,120Updated this week
- ☆16Jul 20, 2026Updated last month
- GPU plugin to the node feature discovery for Kubernetes☆308May 27, 2024Updated 2 years ago
- Heterogeneous GPU Sharing on Kubernetes☆4,635Updated this week
- LeaderWorkerSet: An API for deploying a group of pods as a unit of replication☆817Updated this week
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- A JupyterLab extension for displaying dashboards of GPU usage.☆679Updated this week
- The NVIDIA Driver Manager is a Kubernetes component which assist in seamless upgrades of NVIDIA Driver on each node of the cluster.☆55Updated this week
- An Envoy inspired, ultimate LLM-first gateway for LLM serving and downstream application developers and enterprises☆27Apr 24, 2025Updated last year
- The Triton Inference Server provides an optimized cloud and edge inferencing solution.☆10,996Updated this week
- ☆12Aug 27, 2024Updated 2 years ago
- ☆211Jul 12, 2026Updated 2 months ago
- Supercharge Your Model Training☆5,495Apr 29, 2026Updated 4 months ago
- NVIDIA device plugin for Kubernetes☆3,873Updated this week
- Tools for building GPU clusters☆1,473Updated this week
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Kubernetes Operator for MPI-based applications (distributed training, HPC, etc.)☆536Updated this week
- elastic-gpu-scheduler is a Kubernetes scheduler extender for GPU resources scheduling.☆147Nov 21, 2022Updated 3 years ago
- Python client for the Run:ai REST API☆26Dec 15, 2025Updated 9 months ago
- Simple, safe way to store and distribute tensors☆3,900Updated this week
- GPU Sharing Scheduler for Kubernetes Cluster☆1,532Dec 29, 2023Updated 2 years ago
- AI Inference Operator for Kubernetes. The easiest way to serve ML models in production. Supports VLMs, LLMs, embeddings, and speech-to-te…☆1,265Updated this week
- Containers for machine learning☆9,481Updated this week