Bruce-Lee-LY / cuda_hookLinks
Hooked CUDA-related dynamic libraries by using automated code generation tools.
☆167Updated last year
Alternatives and similar repositories for cuda_hook
Users that are interested in cuda_hook are comparing it to the libraries listed below
Sorting:
- An efficient GPU resource sharing system with fine-grained control for Linux platforms.☆85Updated last year
- cricket is a virtualization solution for GPUs☆215Updated last month
- Artifacts for our NSDI'23 paper TGS☆89Updated last year
- This repository is an archive. Refer to https://github.com/gvirtus/GVirtuS☆45Updated 3 years ago
- GPU-scheduler-for-deep-learning☆210Updated 4 years ago
- Fast OS-level support for GPU checkpoint and restore☆245Updated last month
- example code for using DC QP for providing RDMA READ and WRITE operations to remote GPU memory☆145Updated last year
- RDMA and SHARP plugins for nccl library☆210Updated last week
- qCUDA: GPGPU Virtualization at a New API Remoting Method with Para-virtualization☆129Updated 3 years ago
- NCCL Profiling Kit☆145Updated last year
- NVIDIA NCCL Tests for Distributed Training☆116Updated this week
- An interference-aware scheduler for fine-grained GPU sharing☆150Updated 9 months ago
- ☆537Updated last year
- Intercepting CUDA runtime calls with LD_PRELOAD☆42Updated 11 years ago
- HAMi-core compiles libvgpu.so, which ensures hard limit on GPU in container☆244Updated 2 weeks ago
- NVIDIA Inference Xfer Library (NIXL)☆688Updated this week
- A tool for bandwidth measurements on NVIDIA GPUs.☆553Updated 6 months ago
- ☆377Updated last year
- Paella: Low-latency Model Serving with Virtualized GPU Scheduling☆62Updated last year
- GLake: optimizing GPU memory management and IO transmission.☆483Updated 7 months ago
- Splits single Nvidia GPU into multiple partitions with complete compute and memory isolation (wrt to performace) between the partitions☆160Updated 6 years ago
- ☆24Updated last year
- A kubernetes plugin which enables dynamically add or remove GPU resources for a running Pod☆128Updated 3 years ago
- CUDA checkpoint and restore utility☆377Updated last month
- ☆53Updated 10 months ago
- NVIDIA Data Center GPU Manager (DCGM) is a project for gathering telemetry and measuring the health of NVIDIA GPUs☆601Updated 2 weeks ago
- DeepSeek-V3/R1 inference performance simulator☆170Updated 7 months ago
- Ultra and Unified CCL☆630Updated this week
- KV cache store for distributed LLM inference☆346Updated last month
- Efficient and easy multi-instance LLM serving☆502Updated last month