Alternatives and similar repositories for cuda_hook:

Users that are interested in cuda_hook are comparing it to the libraries listed below

• NTHU-LSALAB / Gemini
  An efficient GPU resource sharing system with fine-grained control for Linux platforms.
  ☆82Updated last year
• RWTH-ACS / cricket
  cricket is a virtualization solution for GPUs
  ☆192Updated 2 months ago
• pkusys / TGS
  Artifacts for our NSDI'23 paper TGS
  ☆75Updated 10 months ago
• Mellanox / gpu_direct_rdma_access
  example code for using DC QP for providing RDMA READ and WRITE operations to remote GPU memory
  ☆127Updated 8 months ago
• coldfunction / qCUDA
  qCUDA: GPGPU Virtualization at a New API Remoting Method with Para-virtualization
  ☆122Updated 3 years ago
• Mellanox / nccl-rdma-sharp-plugins
  RDMA and SHARP plugins for nccl library
  ☆189Updated 2 weeks ago
• microsoft / NPKit
  NCCL Profiling Kit
  ☆130Updated 9 months ago
• cjg / GVirtuS
  This repository is an archive. Refer to https://github.com/gvirtus/GVirtuS
  ☆41Updated 3 years ago
• eth-easl / orion
  An interference-aware scheduler for fine-grained GPU sharing
  ☆132Updated 2 months ago
• eniac / paella
  Paella: Low-latency Model Serving with Virtualized GPU Scheduling
  ☆58Updated 11 months ago
• ai-dynamo / nixl
  NVIDIA Inference Xfer Library (NIXL)
  ☆273Updated this week
• coreweave / nccl-tests
  NVIDIA NCCL Tests for Distributed Training
  ☆88Updated this week
• alibaba / GPU-scheduler-for-deep-learning
  GPU-scheduler-for-deep-learning
  ☆204Updated 4 years ago
• Project-HAMi / HAMi-core
  HAMi-core compiles libvgpu.so, which ensures hard limit on GPU in container
  ☆157Updated last week
• nchong / cudahook
  Intercepting CUDA runtime calls with LD_PRELOAD
  ☆39Updated 11 years ago
• mlcommons / chakra
  Repository for MLCommons Chakra schema and tools
  ☆95Updated last month
• pokerfaceSad / GPUMounter
  A kubernetes plugin which enables dynamically add or remove GPU resources for a running Pod
  ☆124Updated 3 years ago
• gvirtus / GVirtuS
  ☆48Updated 7 months ago
• zw0610 / zw0610.github.io
  ☆58Updated 4 years ago
• microsoft / msccl-tools
  Synthesizer for optimal collective communication algorithms
  ☆105Updated last year
• SymbioticLab / Salus
  Fine-grained GPU sharing primitives
  ☆141Updated 5 years ago
• paperg / NCCL_GP
  Separate from hardware and used to learn some NCCL mechanisms
  ☆18Updated last year
• SJTU-IPADS / PhoenixOS
  Fast OS-level support for GPU checkpoint and restore
  ☆183Updated last week
• sakjain92 / Fractional-GPUs
  Splits single Nvidia GPU into multiple partitions with complete compute and memory isolation (wrt to performace) between the partitions
  ☆159Updated 6 years ago
• AlibabaPAI / llumnix
  Efficient and easy multi-instance LLM serving
  ☆383Updated this week
• microsoft / msccl
  Microsoft Collective Communication Library
  ☆343Updated last year
• SJTU-IPADS / reef
  REEF is a GPU-accelerated DNN inference serving system that enables instant kernel preemption and biased concurrent execution in GPU sche…
  ☆94Updated 2 years ago
• google / nccl-fastsocket
  NCCL Fast Socket is a transport layer plugin to improve NCCL collective communication performance on Google Cloud.
  ☆116Updated last year
• DMTCP-CRAC / CRAC-early-development
  ☆24Updated last year
• zartbot / shallowsim
  DeepSeek-V3/R1 inference performance simulator
  ☆111Updated 3 weeks ago