cakeng / ASPENLinks
This is the proof-of-concept CPU implementation of ASPEN used for the NeurIPS'23 paper ASPEN: Breaking Operator Barriers for Efficient Parallelization of Deep Neural Networks.
☆13Updated last year
Alternatives and similar repositories for ASPEN
Users that are interested in ASPEN are comparing it to the libraries listed below
Sorting:
- ☆25Updated 2 years ago
- ☆34Updated 2 months ago
- Ok-Topk is a scheme for distributed training with sparse gradients. Ok-Topk integrates a novel sparse allreduce algorithm (less than 6k c…☆27Updated 3 years ago
- TiledLower is a Dataflow Analysis and Codegen Framework written in Rust.☆14Updated last year
- Official Repo for "SplitQuant / LLM-PQ: Resource-Efficient LLM Offline Serving on Heterogeneous GPUs via Phase-Aware Model Partition and …☆36Updated 4 months ago
- Hi-Speed DNN Training with Espresso: Unleashing the Full Potential of Gradient Compression with Near-Optimal Usage Strategies (EuroSys '2…☆15Updated 2 years ago
- Repository for MLCommons Chakra schema and tools☆39Updated 2 years ago
- Proteus: A High-Throughput Inference-Serving System with Accuracy Scaling☆12Updated last year
- ☆41Updated 5 years ago
- ☆21Updated 3 years ago
- LLM serving cluster simulator☆132Updated last year
- ☆10Updated 2 years ago
- ☆14Updated 3 years ago
- LLM Inference analyzer for different hardware platforms☆98Updated last month
- Torch2Chip (MLSys, 2024)☆55Updated 9 months ago
- Supplemental materials for The ASPLOS 2025 / EuroSys 2025 Contest on Intra-Operator Parallelism for Distributed Deep Learning☆24Updated 7 months ago
- TACCL: Guiding Collective Algorithm Synthesis using Communication Sketches☆79Updated 2 years ago
- Thunder Research Group's Collective Communication Library☆46Updated 6 months ago
- ☆15Updated 3 years ago
- ☆16Updated 8 months ago
- ☆58Updated last year
- A minimum demo for PyTorch distributed extension functionality for collectives.☆15Updated last year
- [TBD] "m4: A Learned Flow-level Network Simulator" by Chenning Li, Anton A. Zabreyko, Om Chabra, Arash Nasr-Esfahany, Kevin Zhao, Pratees…☆16Updated last month
- ☆38Updated 6 months ago
- Open-source implementation for "Helix: Serving Large Language Models over Heterogeneous GPUs and Network via Max-Flow"☆75Updated 2 months ago
- ☆24Updated last year
- Chimera: bidirectional pipeline parallelism for efficiently training large-scale models.☆69Updated 9 months ago
- ☆47Updated last year
- ☆14Updated 2 months ago
- GPU-accelerated LLM Training Simulator☆15Updated 6 months ago