aliyun / SimAILinks
☆546Updated last week
Alternatives and similar repositories for SimAI
Users that are interested in SimAI are comparing it to the libraries listed below
Sorting:
- ☆203Updated 3 weeks ago
- ☆42Updated 7 months ago
- ☆59Updated last month
- ASTRA-sim2.0: Modeling Hierarchical Networks and Disaggregated Systems for Large-model Training at Scale☆378Updated this week
- Curated collection of papers in machine learning systems☆364Updated last week
- ☆295Updated last year
- DeepSeek-V3/R1 inference performance simulator☆149Updated 2 months ago
- FlagPerf is an open-source software platform for benchmarking AI chips.☆338Updated this week
- A large-scale simulation framework for LLM inference☆387Updated 7 months ago
- paper and its code for AI System☆311Updated 2 months ago
- Repository for MLCommons Chakra schema and tools☆109Updated this week
- GLake: optimizing GPU memory management and IO transmission.☆467Updated 2 months ago
- Here are my personal paper reading notes (including cloud computing, resource management, systems, machine learning, deep learning, and o…☆107Updated last week
- Disaggregated serving system for Large Language Models (LLMs).☆617Updated 2 months ago
- A highly optimized LLM inference acceleration engine for Llama and its variants.☆899Updated last month
- ☆138Updated last year
- Microsoft Collective Communication Library☆349Updated last year
- Artifacts for our NSDI'23 paper TGS☆76Updated last year
- This repository is established to store personal notes and annotated papers during daily research.☆128Updated this week
- ☆186Updated 2 years ago
- ☆16Updated 4 months ago
- Efficient and easy multi-instance LLM serving☆437Updated this week
- An interference-aware scheduler for fine-grained GPU sharing☆140Updated 4 months ago
- NCCL Profiling Kit☆137Updated 11 months ago
- An acceleration library that supports arbitrary bit-width combinatorial quantization operations☆224Updated 8 months ago
- LLM serving cluster simulator☆106Updated last year
- A low-latency & high-throughput serving engine for LLMs☆380Updated 3 weeks ago
- TACCL: Guiding Collective Algorithm Synthesis using Communication Sketches☆73Updated last year
- MIXQ: Taming Dynamic Outliers in Mixed-Precision Quantization by Online Prediction☆90Updated 7 months ago
- Injecting Adrenaline into LLM Serving: Boosting Resource Utilization and Throughput via Attention Disaggregation☆23Updated 2 months ago