Alternatives and similar repositories for msccl-executor-nccl:

Users that are interested in msccl-executor-nccl are comparing it to the libraries listed below

• microsoft / NPKit
  NCCL Profiling Kit
  ☆127Updated 8 months ago
• Azure / msccl
  Microsoft Collective Communication Library
  ☆60Updated 3 months ago
• eniac / paella
  Paella: Low-latency Model Serving with Virtualized GPU Scheduling
  ☆58Updated 10 months ago
• Oneflow-Inc / dfccl
  ☆20Updated last month
• AlibabaPAI / FLASHNN
  ☆87Updated 6 months ago
• microsoft / nnscaler
  nnScaler: Compiling DNN models for Parallel Training
  ☆101Updated last month
• feifeibear / LLMRoofline
  Compare different hardware platforms via the Roofline Model for LLM inference tasks.
  ☆93Updated last year
• alibaba / easydist
  Automated Parallelization System and Infrastructure for Multiple Ecosystems
  ☆78Updated 4 months ago
• mcrl / tccl
  Thunder Research Group's Collective Communication Library
  ☆33Updated 10 months ago
• flexflow / flexflow-serve
  FlexFlow Serve: Low-Latency, High-Performance LLM Serving
  ☆29Updated this week
• google / nccl-fastsocket
  NCCL Fast Socket is a transport layer plugin to improve NCCL collective communication performance on Google Cloud.
  ☆116Updated last year
• yifuwang / symm-mem-recipes
  ☆55Updated 2 months ago
• ROCm / rccl-tests
  RCCL Performance Benchmark Tests
  ☆60Updated last week
• zhuohan123 / terapipe
  ☆72Updated 3 years ago
• DefTruth / hgemm-mma
  ⚡️Write HGEMM from scratch using Tensor Cores with WMMA, MMA and CuTe API, Achieve Peak⚡️ Performance.
  ☆59Updated 2 weeks ago
• bytedance / InfiniStore
  A distributed KV store for disaggregated LLM inference
  ☆62Updated this week
• alibaba / llm-scheduling-artifact
  Artifact of OSDI '24 paper, ”Llumnix: Dynamic Scheduling for Large Language Model Serving“
  ☆60Updated 9 months ago
• parasailteam / coconet
  ☆75Updated 2 years ago
• microsoft / msccl-tools
  Synthesizer for optimal collective communication algorithms
  ☆106Updated 11 months ago
• AlibabaPAI / torchacc
  PyTorch distributed training acceleration framework
  ☆44Updated last month
• awslabs / optimizing-multitask-training-through-dynamic-pipelines
  Official repository for the paper DynaPipe: Optimizing Multi-task Training through Dynamic Pipelines
  ☆17Updated last year
• WukLab / preble
  Stateful LLM Serving
  ☆48Updated last week
• LLMServe / SwiftTransformer
  High performance Transformer implementation in C++.
  ☆105Updated 2 months ago
• microsoft / mscclpp
  MSCCL++: A GPU-driven communication stack for scalable AI applications
  ☆311Updated this week
• ROCm / TransformerEngine
  ☆24Updated this week
• ParCIS / Chimera
  Chimera: Efficiently Training Large-Scale Neural Networks with Bidirectional Pipelines.
  ☆60Updated last year
• FlagOpen / FlagCX
  ☆45Updated this week
• ColfaxResearch / cfx-article-src
  ☆87Updated last week