microsoft / taccl
TACCL: Guiding Collective Algorithm Synthesis using Communication Sketches
☆69Updated last year
Alternatives and similar repositories for taccl:
Users that are interested in taccl are comparing it to the libraries listed below
- Synthesizer for optimal collective communication algorithms☆103Updated 10 months ago
- NCCL Profiling Kit☆127Updated 7 months ago
- Repository for MLCommons Chakra schema and tools☆39Updated last year
- Repository for MLCommons Chakra schema and tools☆84Updated 2 weeks ago
- ☆44Updated last month
- LLM serving cluster simulator☆92Updated 9 months ago
- [NSDI 2023] TopoOpt: Optimizing the Network Topology for Distributed DNN Training☆27Updated 5 months ago
- Bamboo is a system for running large pipeline-parallel DNNs affordably, reliably, and efficiently using spot instances.☆48Updated 2 years ago
- Microsoft Collective Communication Library☆61Updated 2 months ago
- AlpaServe: Statistical Multiplexing with Model Parallelism for Deep Learning Serving (OSDI 23)☆81Updated last year
- ASTRA-sim2.0: Modeling Hierarchical Networks and Disaggregated Systems for Large-model Training at Scale☆315Updated last week
- REEF is a GPU-accelerated DNN inference serving system that enables instant kernel preemption and biased concurrent execution in GPU sche…☆90Updated 2 years ago
- An interference-aware scheduler for fine-grained GPU sharing☆122Updated 2 weeks ago
- ☆180Updated last month
- ☆74Updated 2 years ago
- ☆23Updated 2 years ago
- Ultra | Ultimate | Unified CCL☆30Updated this week
- Microsoft Collective Communication Library☆332Updated last year
- ☆48Updated 2 years ago
- ☆18Updated 7 months ago
- ☆183Updated 5 years ago
- Paella: Low-latency Model Serving with Virtualized GPU Scheduling☆58Updated 9 months ago
- ☆35Updated last year
- ☆23Updated last year
- ☆37Updated 3 years ago
- Artifacts for our ASPLOS'23 paper ElasticFlow☆53Updated 9 months ago
- ☆40Updated 7 months ago
- Managed collective communication service☆17Updated 5 months ago
- ☆43Updated 3 years ago
- Thunder Research Group's Collective Communication Library☆32Updated 9 months ago