Practical GPU Sharing Without Memory Size Constraints
☆306Mar 28, 2025Updated 11 months ago
Alternatives and similar repositories for nvshare
Users that are interested in nvshare are comparing it to the libraries listed below
Sorting:
- Artifacts for our NSDI'23 paper TGS☆96Jun 10, 2024Updated last year
- Tacker: Tensor-CUDA Core Kernel Fusion for Improving the GPU Utilization while Ensuring QoS☆34Feb 10, 2025Updated last year
- Heterogeneous AI Computing Virtualization Middleware(Project under CNCF)☆3,047Updated this week
- GPU Sharing Scheduler for Kubernetes Cluster☆1,528Dec 29, 2023Updated 2 years ago
- An efficient GPU resource sharing system with fine-grained control for Linux platforms.☆88Mar 25, 2024Updated last year
- HAMi-core compiles libvgpu.so, which ensures hard limit on GPU in container☆278Feb 25, 2026Updated last week
- Hooked CUDA-related dynamic libraries by using automated code generation tools.☆171Dec 12, 2023Updated 2 years ago
- ☆539Jun 7, 2024Updated last year
- NVIDIA DRA Driver for GPUs☆574Feb 26, 2026Updated last week
- Share GPU between Pods in Kubernetes☆216Feb 6, 2023Updated 3 years ago
- This tool provides a native Kubernetes API-based port-forwarding solution, allowing users to forward ports from Kubernetes.☆19Nov 1, 2025Updated 4 months ago
- ☆18Jul 20, 2021Updated 4 years ago
- SCV is a distributed cluster GPU sniffer. SCV是 一个分布式GPU嗅探器☆20Feb 25, 2023Updated 3 years ago
- A kubernetes plugin which enables dynamically add or remove GPU resources for a running Pod☆127Feb 23, 2022Updated 4 years ago
- cricket is a virtualization solution for GPUs☆236Sep 9, 2025Updated 5 months ago
- Using CRDs to manage GPU resources in Kubernetes.☆209Nov 21, 2022Updated 3 years ago
- Splits single Nvidia GPU into multiple partitions with complete compute and memory isolation (wrt to performace) between the partitions☆164Apr 21, 2019Updated 6 years ago
- qCUDA: GPGPU Virtualization at a New API Remoting Method with Para-virtualization☆134Feb 9, 2022Updated 4 years ago
- ☆24Jun 12, 2023Updated 2 years ago
- GPU Sharing Device Plugin for Kubernetes Cluster☆492Jan 10, 2023Updated 3 years ago
- elastic-gpu-scheduler is a Kubernetes scheduler extender for GPU resources scheduling.☆145Nov 21, 2022Updated 3 years ago
- OpenAIOS vGPU device plugin for Kubernetes is originated from the OpenAIOS project to virtualize GPU device memory, in order to allow app…☆584May 21, 2024Updated last year
- Module to Automatically maximize the utilization of GPU resources in a Kubernetes cluster through real-time dynamic partitioning and elas…☆684Apr 21, 2024Updated last year
- ☆892Apr 2, 2024Updated last year
- K8s device plugin for GPU sharing☆98May 10, 2023Updated 2 years ago
- Paella: Low-latency Model Serving with Virtualized GPU Scheduling☆68May 1, 2024Updated last year
- A simulator of Kuberntes for batch and service workload.☆50Mar 26, 2021Updated 4 years ago
- CUDA checkpoint and restore utility☆424Sep 15, 2025Updated 5 months ago
- Intelligent platform for AI workloads☆37Jan 24, 2023Updated 3 years ago
- GPU scheduler for elastic/distributed deep learning workloads in Kubernetes cluster (IC2E'23)☆34Nov 11, 2023Updated 2 years ago
- NVIDIA GPU Operator creates, configures, and manages GPUs in Kubernetes☆2,572Updated this week
- More Flexible Device Extension Capability in Kubernetes (DevicePlugins++)☆25Jun 12, 2023Updated 2 years ago
- ☆20Jul 10, 2025Updated 7 months ago
- AWS virtual gpu device plugin provides capability to use smaller virtual gpus for your machine learning inference workloads☆204Nov 22, 2023Updated 2 years ago
- NVIDIA device plugin for Kubernetes☆3,679Updated this week
- GPU environment and cluster management with LLM support☆658May 16, 2024Updated last year
- Source code for OSDI 2023 paper titled "Cilantro - Performance-Aware Resource Allocation for General Objectives via Online Feedback"☆40Jul 6, 2023Updated 2 years ago
- ☆74Updated this week
- Sniff CUDA ioctls☆225May 4, 2023Updated 2 years ago