Alternatives and similar repositories for NCCL_GP:

Users that are interested in NCCL_GP are comparing it to the libraries listed below

• eniac / paella
  Paella: Low-latency Model Serving with Virtualized GPU Scheduling
  ☆58Updated 10 months ago
• Mellanox / gpu_direct_rdma_access
  example code for using DC QP for providing RDMA READ and WRITE operations to remote GPU memory
  ☆124Updated 8 months ago
• microsoft / NPKit
  NCCL Profiling Kit
  ☆128Updated 8 months ago
• aliyun / aicb
  ☆193Updated 2 months ago
• Bruce-Lee-LY / cuda_hook
  Hooked CUDA-related dynamic libraries by using automated code generation tools.
  ☆150Updated last year
• Mellanox / nccl-rdma-sharp-plugins
  RDMA and SHARP plugins for nccl library
  ☆184Updated last week
• microsoft / msccl-tools
  Synthesizer for optimal collective communication algorithms
  ☆105Updated 11 months ago
• mcrl / tccl
  Thunder Research Group's Collective Communication Library
  ☆35Updated 11 months ago
• shenh10 / DeepSeek_Simulator
  ☆21Updated last week
• mlcommons / chakra
  Repository for MLCommons Chakra schema and tools
  ☆94Updated 2 weeks ago
• calculon-ai / calculon
  ☆132Updated last year
• parasailteam / coconet
  ☆76Updated 2 years ago
• alibaba / llm-scheduling-artifact
  Artifact of OSDI '24 paper, ”Llumnix: Dynamic Scheduling for Large Language Model Serving“
  ☆60Updated 9 months ago
• lipracer / cuda-rt-hook
  ☆33Updated 2 months ago
• google / nccl-fastsocket
  NCCL Fast Socket is a transport layer plugin to improve NCCL collective communication performance on Google Cloud.
  ☆116Updated last year
• microsoft / taccl
  TACCL: Guiding Collective Algorithm Synthesis using Communication Sketches
  ☆72Updated last year
• astra-sim / astra-sim
  ASTRA-sim2.0: Modeling Hierarchical Networks and Disaggregated Systems for Large-model Training at Scale
  ☆333Updated last month
• abhibambhaniya / GenZ-LLM-Analyzer
  LLM Inference analyzer for different hardware platforms
  ☆54Updated last week
• bytedance / ByteMLPerf
  AI Accelerator Benchmark focuses on evaluating AI Accelerators from a practical production perspective, including the ease of use and ver…
  ☆233Updated this week
• FdyCN / PTX-ISA
  CUDA PTX-ISA Document 中文翻译版
  ☆37Updated 2 weeks ago
• SJTU-IPADS / reef
  REEF is a GPU-accelerated DNN inference serving system that enables instant kernel preemption and biased concurrent execution in GPU sche…
  ☆94Updated 2 years ago
• alibaba / TePDist
  TePDist (TEnsor Program DISTributed) is an HLO-level automatic distributed system for DL models.
  ☆92Updated last year
• zartbot / shallowsim
  DeepSeek-V3/R1 inference performance simulator
  ☆89Updated this week
• casys-kaist / HUVM
  ☆23Updated 2 years ago
• StarryVae / RDMA-tutorial
  ☆163Updated 2 years ago
• HaifengSun-Kira / RDMA-Tutorial
  ☆35Updated 3 years ago
• reed-lau / cute-gemm
  ☆112Updated 3 months ago
• eth-easl / orion
  An interference-aware scheduler for fine-grained GPU sharing
  ☆129Updated 2 months ago
• mlcommons / chakra-old
  Repository for MLCommons Chakra schema and tools
  ☆39Updated last year
• OpenPPL / ppl.llm.kernel.cuda
  ☆145Updated 2 months ago