Azure / mscclLinks
Microsoft Collective Communication Library
☆66Updated 10 months ago
Alternatives and similar repositories for msccl
Users that are interested in msccl are comparing it to the libraries listed below
Sorting:
- NCCL Profiling Kit☆145Updated last year
- Thunder Research Group's Collective Communication Library☆42Updated 3 months ago
- ☆83Updated 2 years ago
- ☆46Updated 10 months ago
- A lightweight design for computation-communication overlap.☆181Updated last week
- Automated Parallelization System and Infrastructure for Multiple Ecosystems☆80Updated 11 months ago
- Synthesizer for optimal collective communication algorithms☆118Updated last year
- An experimental parallel training platform☆54Updated last year
- ☆72Updated last year
- AlpaServe: Statistical Multiplexing with Model Parallelism for Deep Learning Serving (OSDI 23)☆88Updated 2 years ago
- ☆90Updated 6 months ago
- PArametrized Recommendation and Ai Model benchmark is a repository for development of numerous uBenchmarks as well as end to end nets for…☆153Updated last week
- Stateful LLM Serving☆86Updated 7 months ago
- Official repository for the paper DynaPipe: Optimizing Multi-task Training through Dynamic Pipelines☆20Updated last year
- TACCL: Guiding Collective Algorithm Synthesis using Communication Sketches☆76Updated 2 years ago
- Paella: Low-latency Model Serving with Virtualized GPU Scheduling☆62Updated last year
- SpotServe: Serving Generative Large Language Models on Preemptible Instances☆129Updated last year
- Artifact of OSDI '24 paper, ”Llumnix: Dynamic Scheduling for Large Language Model Serving“☆62Updated last year
- DeepSeek-V3/R1 inference performance simulator☆170Updated 6 months ago
- NVSHMEM‑Tutorial: Build a DeepEP‑like GPU Buffer☆138Updated last month
- An interference-aware scheduler for fine-grained GPU sharing☆147Updated 8 months ago
- A resilient distributed training framework☆95Updated last year
- Microsoft Collective Communication Library☆367Updated 2 years ago
- MSCCL++: A GPU-driven communication stack for scalable AI applications☆425Updated this week
- FlexFlow Serve: Low-Latency, High-Performance LLM Serving☆63Updated last month
- Chimera: bidirectional pipeline parallelism for efficiently training large-scale models.☆66Updated 7 months ago
- Compiler for Dynamic Neural Networks☆46Updated last year
- Bamboo is a system for running large pipeline-parallel DNNs affordably, reliably, and efficiently using spot instances.☆51Updated 2 years ago
- DLSlime: Flexible & Efficient Heterogeneous Transfer Toolkit☆68Updated last week
- NCCL Fast Socket is a transport layer plugin to improve NCCL collective communication performance on Google Cloud.☆121Updated last year