Alternatives and similar repositories for uccl

Users that are interested in uccl are comparing it to the libraries listed below

• eunomia-bpf / eGPU
  Extending eBPF Programmability and Observability to GPUs (merged into https://github.com/eunomia-bpf/bpftime)
  ☆288Updated 2 months ago
• aliyun / SimAI
  ☆803Updated 3 weeks ago
• SlugLab / CXLMemSim
  CXLMemSim: A pure software simulated CXL.mem for performance characterization
  ☆504Updated this week
• Zefan-Cai / KVCache-Factory
  Unified KV Cache Compression Methods for Auto-Regressive Models
  ☆1,298Updated last year
• zhihu / ZhiLight
  A highly optimized LLM inference acceleration engine for Llama and its variants.
  ☆905Updated 6 months ago
• bytedance / ABQ-LLM
  An acceleration library that supports arbitrary bit-width combinatorial quantization operations
  ☆240Updated last year
• CXLMemUring / CXLMemUring
  CXL remote offloading data movement aware compiler
  ☆71Updated 3 weeks ago
• hyperai / tvm-cn
  TVM Documentation in Chinese Simplified / TVM 中文文档
  ☆3,110Updated 2 months ago
• Zefan-Cai / R-KV
  [Neurips 2025] R-KV: Redundancy-aware KV Cache Compression for Reasoning Models
  ☆1,170Updated 3 months ago
• ChenmienTan / RL2
  ☆1,089Updated last week
• expert-kit / expert-kit
  Expert Kit is an efficient foundation of Expert Parallelism (EP) for MoE model Inference on heterogenous hardware
  ☆61Updated this week
• Multi-V-VM / hetGPU
  PTX on XPUs
  ☆119Updated last week
• Multi-V-VM / MVVM
  Heterogeneous Containerization of Large Language Model Apps
  ☆109Updated 6 months ago
• ByteDance-Seed / ShadowKV
  [ICML 2025 Spotlight] ShadowKV: KV Cache in Shadows for High-Throughput Long-Context LLM Inference
  ☆280Updated 8 months ago
• flagos-ai / FlagPerf
  FlagPerf is an open-source software platform for benchmarking AI chips.
  ☆359Updated 2 months ago
• abdelfattah-lab / BitMoD-HPCA-25
  ☆140Updated 6 months ago
• AIoT-MLSys-Lab / SVD-LLM
  [ICLR 2025🔥] SVD-LLM & [NAACL 2025🔥] SVD-LLM V2
  ☆275Updated 5 months ago
• antgroup / glake
  GLake: optimizing GPU memory management and IO transmission.
  ☆497Updated 10 months ago
• AlibabaPAI / llumnix
  Efficient and easy multi-instance LLM serving
  ☆523Updated 4 months ago
• bytedance / InfiniStore
  KV cache store for distributed LLM inference
  ☆387Updated 2 months ago
• ai-dynamo / nixl
  NVIDIA Inference Xfer Library (NIXL)
  ☆844Updated this week
• wqzustc / High-Performance-Tensor-Processing-Engines
  Some Hardware Architectures for GEMM
  ☆286Updated 8 months ago
• stepfun-ai / StepMesh
  ☆340Updated 3 weeks ago
• FastMAS / KVCOMM
  [NeurIPS'25] KVCOMM: Online Cross-context KV-cache Communication for Efficient LLM-based Multi-agent Systems
  ☆125Updated 2 months ago
• zartbot / shallowsim
  DeepSeek-V3/R1 inference performance simulator
  ☆177Updated 10 months ago
• SJTU-IPADS / PhoenixOS
  Fast OS-level support for GPU checkpoint and restore
  ☆270Updated 4 months ago
• microsoft / mscclpp
  MSCCL++: A GPU-driven communication stack for scalable AI applications
  ☆455Updated this week
• maze-agent / Maze
  A distributed framework for LLM agents
  ☆446Updated 2 weeks ago
• LLMServe / SwiftTransformer
  High performance Transformer implementation in C++.
  ☆148Updated last year
• Infini-AI-Lab / TriForce
  [COLM 2024] TriForce: Lossless Acceleration of Long Sequence Generation with Hierarchical Speculative Decoding
  ☆276Updated last year