aliyun / SimAILinks
☆806Updated last month
Alternatives and similar repositories for SimAI
Users that are interested in SimAI are comparing it to the libraries listed below
Sorting:
- ☆231Updated last month
- ☆42Updated last year
- UCCL is an efficient communication library for GPUs, covering collectives, P2P (e.g., KV cache transfer, RL weight transfer), and EP (e.g…☆1,195Updated last week
- ☆77Updated last month
- ASTRA-sim2.0: Modeling Hierarchical Networks and Disaggregated Systems for Large-model Training at Scale☆516Updated last month
- Curated collection of papers in machine learning systems☆503Updated last month
- [NSDI25] AutoCCL: Automated Collective Communication Tuning for Accelerating Distributed and Parallel DNN Training☆30Updated 9 months ago
- ☆323Updated 2 years ago
- This repository is established to store personal notes and annotated papers during daily research.☆180Updated 3 weeks ago
- Disaggregated serving system for Large Language Models (LLMs).☆771Updated 10 months ago
- Microsoft Collective Communication Library☆381Updated 2 years ago
- A large-scale simulation framework for LLM inference☆530Updated 6 months ago
- GPU-accelerated LLM Training Simulator☆50Updated 7 months ago
- DeepSeek-V3/R1 inference performance simulator☆176Updated 10 months ago
- Here are my personal paper reading notes (including machine learning systems, AI infrastructure, and other interesting stuffs).☆155Updated last week
- Repository for MLCommons Chakra schema and tools☆153Updated 3 months ago
- FlagPerf is an open-source software platform for benchmarking AI chips.☆360Updated 2 months ago
- Simulating Distributed Training at Scale☆14Updated 4 months ago
- TACCL: Guiding Collective Algorithm Synthesis using Communication Sketches☆80Updated 2 years ago
- Injecting Adrenaline into LLM Serving: Boosting Resource Utilization and Throughput via Attention Disaggregation☆40Updated 2 months ago
- A ChatGPT(GPT-3.5) & GPT-4 Workload Trace to Optimize LLM Serving Systems☆238Updated this week
- Artifacts for our NSDI'23 paper TGS☆95Updated last year
- ☆166Updated last year
- GLake: optimizing GPU memory management and IO transmission.☆497Updated 10 months ago
- LLM serving cluster simulator☆135Updated last year
- ☆24Updated last year
- paper and its code for AI System☆347Updated last month
- NCCL Profiling Kit☆150Updated last year
- ☆22Updated 11 months ago
- Separate from hardware and used to learn some NCCL mechanisms☆25Updated last year