Alternatives and similar repositories for msccl-executor-nccl:

Users that are interested in msccl-executor-nccl are comparing it to the libraries listed below

• microsoft / NPKit
  NCCL Profiling Kit
  ☆127Updated 7 months ago
• flexflow / flexflow-serve
  FlexFlow Serve: Low-Latency, High-Performance LLM Serving
  ☆17Updated this week
• Azure / msccl
  Microsoft Collective Communication Library
  ☆61Updated 2 months ago
• mcrl / tccl
  Thunder Research Group's Collective Communication Library
  ☆32Updated 9 months ago
• alibaba / easydist
  Automated Parallelization System and Infrastructure for Multiple Ecosystems
  ☆78Updated 2 months ago
• eniac / paella
  Paella: Low-latency Model Serving with Virtualized GPU Scheduling
  ☆58Updated 9 months ago
• microsoft / nnscaler
  nnScaler: Compiling DNN models for Parallel Training
  ☆91Updated this week
• feifeibear / LLMRoofline
  Compare different hardware platforms via the Roofline Model for LLM inference tasks.
  ☆93Updated 11 months ago
• google / nccl-fastsocket
  NCCL Fast Socket is a transport layer plugin to improve NCCL collective communication performance on Google Cloud.
  ☆115Updated last year
• parasailteam / coconet
  ☆74Updated 2 years ago
• WukLab / preble
  Stateful LLM Serving
  ☆46Updated 6 months ago
• alibaba / llm-scheduling-artifact
  Artifact of OSDI '24 paper, ”Llumnix: Dynamic Scheduling for Large Language Model Serving“
  ☆60Updated 8 months ago
• AlibabaPAI / FLASHNN
  ☆81Updated 5 months ago
• microsoft / msccl-tools
  Synthesizer for optimal collective communication algorithms
  ☆103Updated 10 months ago
• DefTruth / hgemm-tensorcores-mma
  ⚡️Write HGEMM from scratch using Tensor Cores with WMMA, MMA and CuTe API, Achieve Peak⚡️ Performance.
  ☆51Updated last week
• LLMServe / SwiftTransformer
  High performance Transformer implementation in C++.
  ☆101Updated 3 weeks ago
• AlibabaPAI / torchacc
  PyTorch distributed training acceleration framework
  ☆39Updated this week
• heheda12345 / MagPy
  ☆38Updated 8 months ago
• FlagOpen / FlagCX
  ☆42Updated this week
• awslabs / optimizing-multitask-training-through-dynamic-pipelines
  Official repository for the paper DynaPipe: Optimizing Multi-task Training through Dynamic Pipelines
  ☆17Updated last year
• zhuohan123 / terapipe
  ☆70Updated 3 years ago
• LoongServe / LoongServe
  ☆83Updated 3 months ago
• microsoft / mscclpp
  MSCCL++: A GPU-driven communication stack for scalable AI applications
  ☆294Updated this week
• Mellanox / nccl-rdma-sharp-plugins
  RDMA and SHARP plugins for nccl library
  ☆175Updated 3 weeks ago
• bd-iaas-us / infiniStore
  A distributed KV store for disaggregated LLM inference
  ☆28Updated this week
• yifuwang / symm-mem-recipes
  ☆42Updated last month
• hao-ai-lab / MuxServe
  ☆50Updated 8 months ago
• GVProf / GVProf
  GVProf: A Value Profiler for GPU-based Clusters
  ☆49Updated 10 months ago
• bytedance / flux
  A fast communication-overlapping library for tensor parallelism on GPUs.
  ☆295Updated 3 months ago
• microsoft / TileFusion
  TileFusion is a highly efficient kernel template library designed to elevate the level of abstraction in CUDA C for processing tiles.
  ☆53Updated this week