astra-sim / tacos
TACOS: [T]opology-[A]ware [Co]llective Algorithm [S]ynthesizer for Distributed Machine Learning
☆19Updated 2 months ago
Alternatives and similar repositories for tacos:
Users that are interested in tacos are comparing it to the libraries listed below
- TACCL: Guiding Collective Algorithm Synthesis using Communication Sketches☆72Updated last year
- Synthesizer for optimal collective communication algorithms☆105Updated last year
- ☆78Updated 2 years ago
- MAGIS: Memory Optimization via Coordinated Graph Transformation and Scheduling for DNN (ASPLOS'24)☆49Updated 10 months ago
- ☆23Updated 2 years ago
- Repository for MLCommons Chakra schema and tools☆39Updated last year
- REEF is a GPU-accelerated DNN inference serving system that enables instant kernel preemption and biased concurrent execution in GPU sche…☆94Updated 2 years ago
- ASPLOS'24: Optimal Kernel Orchestration for Tensor Programs with Korch☆33Updated 3 weeks ago
- Repository for MLCommons Chakra schema and tools☆95Updated last month
- ☆23Updated 9 months ago
- LIBRA: Enabling Workload-aware Multi-dimensional Network Topology Optimization for Distributed Training of Large AI Models☆10Updated 11 months ago
- ☆36Updated last year
- ☆39Updated 2 weeks ago
- LLM serving cluster simulator☆96Updated 11 months ago
- ☆25Updated 4 years ago
- Proteus: A High-Throughput Inference-Serving System with Accuracy Scaling☆10Updated last year
- Thunder Research Group's Collective Communication Library☆36Updated 11 months ago
- ☆29Updated 2 months ago
- Paella: Low-latency Model Serving with Virtualized GPU Scheduling☆58Updated 11 months ago
- ☆47Updated 3 months ago
- LLM Inference analyzer for different hardware platforms☆62Updated last week
- TileFlow is a performance analysis tool based on Timeloop for fusion dataflows☆57Updated last year
- GVProf: A Value Profiler for GPU-based Clusters☆49Updated last year
- Microsoft Collective Communication Library☆65Updated 4 months ago
- Artifacts for our ASPLOS'23 paper ElasticFlow☆51Updated 11 months ago
- Artifact of OSDI '24 paper, ”Llumnix: Dynamic Scheduling for Large Language Model Serving“☆61Updated 10 months ago
- Magicube is a high-performance library for quantized sparse matrix operations (SpMM and SDDMM) of deep learning on Tensor Cores.☆85Updated 2 years ago
- Automatic Mapping Generation, Verification, and Exploration for ISA-based Spatial Accelerators☆107Updated 2 years ago
- Performance Prediction Toolkit for GPUs☆37Updated 3 years ago
- LLMServingSim: A HW/SW Co-Simulation Infrastructure for LLM Inference Serving at Scale☆105Updated last month