Bruce-Lee-LY / cuda_hook
Hooked CUDA-related dynamic libraries by using automated code generation tools.
☆153Updated last year
Alternatives and similar repositories for cuda_hook
Users that are interested in cuda_hook are comparing it to the libraries listed below
Sorting:
- An efficient GPU resource sharing system with fine-grained control for Linux platforms.☆82Updated last year
- cricket is a virtualization solution for GPUs☆194Updated 3 weeks ago
- This repository is an archive. Refer to https://github.com/gvirtus/GVirtuS☆42Updated 3 years ago
- Artifacts for our NSDI'23 paper TGS☆75Updated 11 months ago
- example code for using DC QP for providing RDMA READ and WRITE operations to remote GPU memory☆129Updated 9 months ago
- qCUDA: GPGPU Virtualization at a New API Remoting Method with Para-virtualization☆122Updated 3 years ago
- RDMA and SHARP plugins for nccl library☆193Updated last month
- NVIDIA NCCL Tests for Distributed Training☆89Updated last week
- Paella: Low-latency Model Serving with Virtualized GPU Scheduling☆58Updated last year
- Intercepting CUDA runtime calls with LD_PRELOAD☆39Updated 11 years ago
- GPU-scheduler-for-deep-learning☆205Updated 4 years ago
- NCCL Profiling Kit☆133Updated 10 months ago
- An interference-aware scheduler for fine-grained GPU sharing☆133Updated 3 months ago
- HAMi-core compiles libvgpu.so, which ensures hard limit on GPU in container☆163Updated 2 weeks ago
- ☆24Updated last year
- ☆48Updated 8 months ago
- ☆58Updated 4 years ago
- Fast OS-level support for GPU checkpoint and restore☆185Updated this week
- A kubernetes plugin which enables dynamically add or remove GPU resources for a running Pod☆125Updated 3 years ago
- KV cache store for distributed LLM inference☆171Updated last week
- ☆61Updated last month
- NCCL Fast Socket is a transport layer plugin to improve NCCL collective communication performance on Google Cloud.☆116Updated last year
- NVIDIA Inference Xfer Library (NIXL)☆315Updated this week
- Repository for MLCommons Chakra schema and tools☆96Updated last month
- ☆527Updated 11 months ago
- A prefill & decode disaggregated LLM serving framework with shared GPU memory and fine-grained compute isolation.☆73Updated last week
- DeepSeek-V3/R1 inference performance simulator☆117Updated last month
- Microsoft Collective Communication Library☆345Updated last year
- CUDA checkpoint and restore utility☆330Updated 3 months ago
- Lightweight daemon for monitoring CUDA runtime API calls with eBPF uprobes☆93Updated last month