Bruce-Lee-LY / cuda_hook
Hooked CUDA-related dynamic libraries by using automated code generation tools.
☆149Updated last year
Alternatives and similar repositories for cuda_hook:
Users that are interested in cuda_hook are comparing it to the libraries listed below
- An efficient GPU resource sharing system with fine-grained control for Linux platforms.☆78Updated 11 months ago
- Artifacts for our NSDI'23 paper TGS☆74Updated 9 months ago
- cricket is a virtualization solution for GPUs☆187Updated last month
- qCUDA: GPGPU Virtualization at a New API Remoting Method with Para-virtualization☆120Updated 3 years ago
- GPU-scheduler-for-deep-learning☆202Updated 4 years ago
- This repository is an archive. Refer to https://github.com/gvirtus/GVirtuS☆41Updated 3 years ago
- example code for using DC QP for providing RDMA READ and WRITE operations to remote GPU memory☆120Updated 7 months ago
- HAMi-core compiles libvgpu.so, which ensures hard limit on GPU in container☆143Updated 2 weeks ago
- RDMA and SHARP plugins for nccl library☆182Updated last month
- NVIDIA NCCL Tests for Distributed Training☆84Updated this week
- ☆43Updated 6 months ago
- Intercepting CUDA runtime calls with LD_PRELOAD☆39Updated 11 years ago
- An interference-aware scheduler for fine-grained GPU sharing☆127Updated last month
- Fine-grained GPU sharing primitives☆141Updated 5 years ago
- Paella: Low-latency Model Serving with Virtualized GPU Scheduling☆58Updated 10 months ago
- A kubernetes plugin which enables dynamically add or remove GPU resources for a running Pod☆124Updated 3 years ago
- NCCL Profiling Kit☆127Updated 8 months ago
- Splits single Nvidia GPU into multiple partitions with complete compute and memory isolation (wrt to performace) between the partitions☆157Updated 5 years ago
- ☆236Updated this week
- Efficient and easy multi-instance LLM serving☆332Updated this week
- A tool for bandwidth measurements on NVIDIA GPUs.☆386Updated last month
- ☆24Updated last year
- NCCL Fast Socket is a transport layer plugin to improve NCCL collective communication performance on Google Cloud.☆116Updated last year
- Fast OS-level support for GPU checkpoint and restore☆168Updated 2 weeks ago
- ☆521Updated 9 months ago
- Repository for MLCommons Chakra schema and tools☆92Updated 3 weeks ago
- Magnum IO community repo☆85Updated last month
- Kubernetes Rdma SRIOV device plugin☆110Updated 4 years ago
- Code for "Heterogenity-Aware Cluster Scheduling Policies for Deep Learning Workloads", which appeared at OSDI 2020☆126Updated 7 months ago
- Automatic tuning for ML model deployment on Kubernetes