Bruce-Lee-LY / cuda_hook
Hooked CUDA-related dynamic libraries by using automated code generation tools.
☆126Updated 9 months ago
Related projects: ⓘ
- cricket is a virtualization solution for GPUs☆139Updated 8 months ago
- An efficient GPU resource sharing system with fine-grained control for Linux platforms.☆67Updated 5 months ago
- qCUDA: GPGPU Virtualization at a New API Remoting Method with Para-virtualization☆110Updated 2 years ago
- This repository is an archive. Refer to https://github.com/gvirtus/GVirtuS☆38Updated 2 years ago
- Artifacts for our NSDI'23 paper TGS☆65Updated 3 months ago
- GPU-scheduler-for-deep-learning☆192Updated 3 years ago
- RDMA and SHARP plugins for nccl library☆154Updated this week
- Paella: Low-latency Model Serving with Virtualized GPU Scheduling☆55Updated 4 months ago
- NCCL Profiling Kit☆104Updated 2 months ago
- example code for using DC QP for providing RDMA READ and WRITE operations to remote GPU memory☆101Updated last month
- Intercepting CUDA runtime calls with LD_PRELOAD☆36Updated 10 years ago
- ☆32Updated 2 weeks ago
- NCCL Fast Socket is a transport layer plugin to improve NCCL collective communication performance on Google Cloud.☆108Updated 10 months ago
- A kubernetes plugin which enables dynamically add or remove GPU resources for a running Pod☆118Updated 2 years ago
- ☆53Updated 4 years ago
- Splits single Nvidia GPU into multiple partitions with complete compute and memory isolation (wrt to performace) between the partitions☆152Updated 5 years ago
- Fine-grained GPU sharing primitives☆139Updated 4 years ago
- An interference-aware scheduler for fine-grained GPU sharing☆92Updated 4 months ago
- Efficient and easy multi-instance LLM serving☆119Updated this week
- NVIDIA NCCL Tests for Distributed Training☆59Updated last month
- Magnum IO community repo☆76Updated 3 months ago
- ☆490Updated 3 months ago
- ☆22Updated 8 months ago
- Code for "Heterogenity-Aware Cluster Scheduling Policies for Deep Learning Workloads", which appeared at OSDI 2020☆124Updated last month
- ☆187Updated this week
- GLake: optimizing GPU memory management and IO transmission.☆351Updated last month
- REEF is a GPU-accelerated DNN inference serving system that enables instant kernel preemption and biased concurrent execution in GPU sche…☆84Updated last year
- Repository for MLCommons Chakra schema and tools☆55Updated last week
- HAMi-core compiles libvgpu.so, which ensures hard limit on GPU in container☆72Updated 2 weeks ago
- ☆306Updated 4 months ago