Alternatives and similar repositories for uccl

Users that are interested in uccl are comparing it to the libraries listed below

• microsoft / mscclpp
  MSCCL++: A GPU-driven communication stack for scalable AI applications
  ☆394Updated this week
• microsoft / NPKit
  NCCL Profiling Kit
  ☆140Updated last year
• microsoft / msccl
  Microsoft Collective Communication Library
  ☆353Updated last year
• ai-dynamo / nixl
  NVIDIA Inference Xfer Library (NIXL)
  ☆502Updated this week
• zartbot / shallowsim
  DeepSeek-V3/R1 inference performance simulator
  ☆158Updated 4 months ago
• ppl-ai / pplx-kernels
  Perplexity GPU Kernels
  ☆418Updated 2 weeks ago
• eth-easl / orion
  An interference-aware scheduler for fine-grained GPU sharing
  ☆142Updated 6 months ago
• AlibabaPAI / llumnix
  Efficient and easy multi-instance LLM serving
  ☆454Updated this week
• microsoft / vattention
  Dynamic Memory Management for Serving LLMs without PagedAttention
  ☆405Updated 2 months ago
• infinigence / FlashOverlap
  A lightweight design for computation-communication overlap.
  ☆155Updated last month
• shenh10 / DeepSeek_Simulator
  ☆83Updated 4 months ago
• HPMLL / BurstGPT
  A ChatGPT(GPT-3.5) & GPT-4 Workload Trace to Optimize LLM Serving Systems
  ☆190Updated last week
• LLMServe / SwiftTransformer
  High performance Transformer implementation in C++.
  ☆129Updated 6 months ago
• microsoft / nnscaler
  nnScaler: Compiling DNN models for Parallel Training
  ☆114Updated this week
• microsoft / sarathi-serve
  A low-latency & high-throughput serving engine for LLMs
  ☆400Updated 2 months ago
• SJTU-IPADS / PhoenixOS
  Fast OS-level support for GPU checkpoint and restore
  ☆225Updated last week
• microsoft / msccl-tools
  Synthesizer for optimal collective communication algorithms
  ☆111Updated last year
• mcrl / tccl
  Thunder Research Group's Collective Communication Library
  ☆39Updated 3 weeks ago
• eniac / paella
  Paella: Low-latency Model Serving with Virtualized GPU Scheduling
  ☆60Updated last year
• mental2008 / awesome-papers
  Here are my personal paper reading notes (including cloud computing, resource management, systems, machine learning, deep learning, and o…
  ☆115Updated this week
• yifuwang / symm-mem-recipes
  ☆102Updated 7 months ago
• byungsoo-oh / ml-systems-papers
  Curated collection of papers in machine learning systems
  ☆388Updated last month
• stepfun-ai / StepMesh
  ☆209Updated this week
• DicardoX / Research-Space
  This repository is established to store personal notes and annotated papers during daily research.
  ☆138Updated last week
• LLMServe / DistServe
  Disaggregated serving system for Large Language Models (LLMs).
  ☆654Updated 4 months ago
• infinigence / Semi-PD
  A prefill & decode disaggregated LLM serving framework with shared GPU memory and fine-grained compute isolation.
  ☆103Updated 2 months ago
• alibaba / llm-scheduling-artifact
  Artifact of OSDI '24 paper, ”Llumnix: Dynamic Scheduling for Large Language Model Serving“
  ☆62Updated last year
• alpa-projects / mms
  AlpaServe: Statistical Multiplexing with Model Parallelism for Deep Learning Serving (OSDI 23)
  ☆83Updated 2 years ago
• bytedance / InfiniStore
  KV cache store for distributed LLM inference
  ☆303Updated 2 months ago
• google / nccl-fastsocket
  NCCL Fast Socket is a transport layer plugin to improve NCCL collective communication performance on Google Cloud.
  ☆119Updated last year