Practical GPU Sharing Without Memory Size Constraints
☆313Mar 28, 2025Updated last year
Alternatives and similar repositories for nvshare
Users that are interested in nvshare are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Artifacts for our NSDI'23 paper TGS☆97Jun 10, 2024Updated last year
- An efficient GPU resource sharing system with fine-grained control for Linux platforms.☆89Mar 25, 2024Updated 2 years ago
- HAMi-core compiles libvgpu.so, which ensures hard limit on GPU in container☆309May 18, 2026Updated last week
- Hooked CUDA-related dynamic libraries by using automated code generation tools.☆172Dec 12, 2023Updated 2 years ago
- An interference-aware scheduler for fine-grained GPU sharing☆162Nov 26, 2025Updated 5 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆542Jun 7, 2024Updated last year
- cricket is a virtualization solution for GPUs☆246Sep 9, 2025Updated 8 months ago
- Tacker: Tensor-CUDA Core Kernel Fusion for Improving the GPU Utilization while Ensuring QoS☆33Feb 10, 2025Updated last year
- Heterogeneous GPU Sharing on Kubernetes☆3,475Updated this week
- A kubernetes plugin which enables dynamically add or remove GPU resources for a running Pod☆127Feb 23, 2022Updated 4 years ago
- GPU Sharing Scheduler for Kubernetes Cluster☆1,531Dec 29, 2023Updated 2 years ago
- DRA Driver for NVIDIA GPUs☆645Updated this week
- qCUDA: GPGPU Virtualization at a New API Remoting Method with Para-virtualization☆134Feb 9, 2022Updated 4 years ago
- Using CRDs to manage GPU resources in Kubernetes.☆210Nov 21, 2022Updated 3 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Share GPU between Pods in Kubernetes☆217Feb 6, 2023Updated 3 years ago
- ☆24Jun 12, 2023Updated 2 years ago
- vgpu.rs is the fractional GPU & vgpu-hypervisor implementation written in Rust☆36May 14, 2026Updated last week
- GPU-scheduler-for-deep-learning☆209Nov 5, 2020Updated 5 years ago
- OpenAIOS vGPU device plugin for Kubernetes is originated from the OpenAIOS project to virtualize GPU device memory, in order to allow app…☆593May 21, 2024Updated 2 years ago
- SCV is a distributed cluster GPU sniffer. SCV是一个分布式GPU嗅探器☆20Feb 25, 2023Updated 3 years ago
- GPU Sharing Device Plugin for Kubernetes Cluster☆495Jan 10, 2023Updated 3 years ago
- elastic-gpu-scheduler is a Kubernetes scheduler extender for GPU resources scheduling.☆145Nov 21, 2022Updated 3 years ago
- Tensor Fusion is a state-of-the-art GPU virtualization and pooling solution designed to optimize GPU cluster utilization to its fullest p…☆152Updated this week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Intelligent platform for AI workloads☆37Jan 24, 2023Updated 3 years ago
- Paella: Low-latency Model Serving with Virtualized GPU Scheduling☆71May 1, 2024Updated 2 years ago
- Sniff CUDA ioctls☆224May 4, 2023Updated 3 years ago
- ☆898Apr 2, 2024Updated 2 years ago
- CUDA checkpoint and restore utility☆450Sep 15, 2025Updated 8 months ago
- ☆329Jan 22, 2024Updated 2 years ago
- AWS virtual gpu device plugin provides capability to use smaller virtual gpus for your machine learning inference workloads☆203Nov 22, 2023Updated 2 years ago
- ☆11Jun 9, 2023Updated 2 years ago
- K8s device plugin for GPU sharing☆100May 10, 2023Updated 3 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- 🧯 Kubernetes coverage for fault awareness and recovery, works for any LLMOps, MLOps, AI workloads.☆35Updated this week
- ☆22Oct 31, 2024Updated last year
- Transparent checkpoint/restart library for CUDA application.☆12Mar 9, 2015Updated 11 years ago
- Module to Automatically maximize the utilization of GPU resources in a Kubernetes cluster through real-time dynamic partitioning and elas…☆685Apr 21, 2024Updated 2 years ago
- Source code for OSDI 2023 paper titled "Cilantro - Performance-Aware Resource Allocation for General Objectives via Online Feedback"☆40Jul 6, 2023Updated 2 years ago
- GLake: optimizing GPU memory management and IO transmission.☆501Mar 24, 2025Updated last year
- GPU environment and cluster management with LLM support☆660May 16, 2024Updated 2 years ago