Alternatives and similar repositories for uccl

Users that are interested in uccl are comparing it to the libraries listed below

• aliyun / SimAI
  ☆706Updated this week
• AlibabaPAI / llumnix
  Efficient and easy multi-instance LLM serving
  ☆504Updated 2 months ago
• ai-dynamo / nixl
  NVIDIA Inference Xfer Library (NIXL)
  ☆688Updated this week
• antgroup / glake
  GLake: optimizing GPU memory management and IO transmission.
  ☆486Updated 7 months ago
• perplexityai / pplx-kernels
  Perplexity GPU Kernels
  ☆513Updated this week
• microsoft / mscclpp
  MSCCL++: A GPU-driven communication stack for scalable AI applications
  ☆427Updated this week
• eth-easl / orion
  An interference-aware scheduler for fine-grained GPU sharing
  ☆150Updated 9 months ago
• LLMServe / SwiftTransformer
  High performance Transformer implementation in C++.
  ☆139Updated 9 months ago
• stepfun-ai / StepMesh
  ☆309Updated last month
• zartbot / shallowsim
  DeepSeek-V3/R1 inference performance simulator
  ☆170Updated 7 months ago
• infinigence / FlashOverlap
  A lightweight design for computation-communication overlap.
  ☆182Updated 3 weeks ago
• bytedance / InfiniStore
  KV cache store for distributed LLM inference
  ☆351Updated last month
• microsoft / vattention
  Dynamic Memory Management for Serving LLMs without PagedAttention
  ☆432Updated 5 months ago
• LLMServe / DistServe
  Disaggregated serving system for Large Language Models (LLMs).
  ☆713Updated 6 months ago
• microsoft / sarathi-serve
  A low-latency & high-throughput serving engine for LLMs
  ☆431Updated 2 weeks ago
• HPMLL / BurstGPT
  A ChatGPT(GPT-3.5) & GPT-4 Workload Trace to Optimize LLM Serving Systems
  ☆215Updated 3 months ago
• SJTU-IPADS / PhoenixOS
  Fast OS-level support for GPU checkpoint and restore
  ☆252Updated last month
• ByteDance-Seed / Triton-distributed
  Distributed Compiler based on Triton for Parallel Systems
  ☆1,206Updated 2 weeks ago
• microsoft / NPKit
  NCCL Profiling Kit
  ☆145Updated last year
• sgl-project / SpecForge
  Train speculative decoding models effortlessly and port them smoothly to SGLang serving.
  ☆451Updated this week
• QLM-project / QLM
  ☆26Updated 9 months ago
• microsoft / msccl
  Microsoft Collective Communication Library
  ☆368Updated 2 years ago
• DicardoX / Research-Space
  This repository is established to store personal notes and annotated papers during daily research.
  ☆157Updated this week
• ByteDance-Seed / ShadowKV
  [ICML 2025 Spotlight] ShadowKV: KV Cache in Shadows for High-Throughput Long-Context LLM Inference
  ☆264Updated 6 months ago
• KuangjuX / NVSHMEM-Tutorial
  NVSHMEM‑Tutorial: Build a DeepEP‑like GPU Buffer
  ☆142Updated last month
• infinigence / Semi-PD
  A prefill & decode disaggregated LLM serving framework with shared GPU memory and fine-grained compute isolation.
  ☆114Updated 5 months ago
• microsoft / nnscaler
  nnScaler: Compiling DNN models for Parallel Training
  ☆118Updated last month
• lambda7xx / awesome-AI-system
  paper and its code for AI System
  ☆333Updated 2 months ago
• WukLab / preble
  Stateful LLM Serving
  ☆87Updated 7 months ago
• shenh10 / DeepSeek_Simulator
  ☆90Updated 7 months ago