LLMServingSim 2.0: A Unified Simulator for Heterogeneous and Disaggregated LLM Serving Infrastructure
☆177Feb 25, 2026Updated this week
Alternatives and similar repositories for LLMServingSim
Users that are interested in LLMServingSim are comparing it to the libraries listed below
Sorting:
- The Artifact of NeoMem: Hardware/Software Co-Design for CXL-Native Memory Tiering☆63Aug 11, 2024Updated last year
- ONNXim is a fast cycle-level simulator that can model multi-core NPUs for DNN inference☆187Jan 8, 2026Updated last month
- NeuPIMs: NPU-PIM Heterogeneous Acceleration for Batched LLM Inferencing☆107Jun 19, 2024Updated last year
- A large-scale simulation framework for LLM inference☆539Jul 25, 2025Updated 7 months ago
- ☆224Oct 24, 2025Updated 4 months ago
- ☆133Jun 24, 2024Updated last year
- mNPUsim: A Cycle-accurate Multi-core NPU Simulator (IISWC 2023)☆72Dec 29, 2025Updated 2 months ago
- ☆167Feb 1, 2025Updated last year
- ☆81May 27, 2025Updated 9 months ago
- Repository to host and maintain SCALE-Sim code☆417Feb 2, 2026Updated last month
- UPMEM LLM Framework allows profiling PyTorch layers and functions and simulate those layers/functions with a given hardware profile.☆37Aug 6, 2025Updated 6 months ago
- ☆26Aug 31, 2023Updated 2 years ago
- ASTRA-sim2.0: Modeling Hierarchical Networks and Disaggregated Systems for Large-model Training at Scale☆522Jan 3, 2026Updated 2 months ago
- Tender: Accelerating Large Language Models via Tensor Decompostion and Runtime Requantization (ISCA'24)☆31Jul 4, 2024Updated last year
- Slowdown prediction module of Echo: Simulating Distributed Training at Scale☆13May 17, 2025Updated 9 months ago
- This GitHub repo contains the artifact for CPElide, which appears at MICRO '24☆13Sep 7, 2024Updated last year
- ☆57Nov 29, 2025Updated 3 months ago
- Processing-In-Memory (PIM) Simulator☆222Dec 12, 2024Updated last year
- A highly-flexible GPU simulator for AMD GPUs.☆218Feb 11, 2026Updated 2 weeks ago
- A systolic array simulator for multi-cycle MACs and varying-byte words, with the paper accepted to HPCA 2022.☆84Nov 7, 2021Updated 4 years ago
- ☆813Dec 31, 2025Updated 2 months ago
- ☆35Jul 9, 2020Updated 5 years ago
- LLM serving cluster simulator☆135Apr 25, 2024Updated last year
- [TBD] "m4: A Learned Flow-level Network Simulator" by Chenning Li, Anton A. Zabreyko, Om Chabra, Arash Nasr-Esfahany, Kevin Zhao, Pratees…☆16Nov 18, 2025Updated 3 months ago
- LLM Inference analyzer for different hardware platforms☆101Feb 17, 2026Updated 2 weeks ago
- Processing in Memory Emulation☆23Feb 24, 2023Updated 3 years ago
- Artifact for paper "PIM is All You Need: A CXL-Enabled GPU-Free System for LLM Inference", ASPLOS 2025☆125May 3, 2025Updated 10 months ago
- ☆234Dec 27, 2025Updated 2 months ago
- PIM-DL: Expanding the Applicability of Commodity DRAM-PIMs for Deep Learning via Algorithm-System Co-Optimization☆36Feb 21, 2024Updated 2 years ago
- ☆84Aug 25, 2025Updated 6 months ago
- ☆115Nov 17, 2023Updated 2 years ago
- Heterogenous ML accelerator☆20May 5, 2025Updated 9 months ago
- Simulator framework for analysis of performance, energy consumption, area and cost of multi-node multi-chiplet tile-based manycore design…☆75Jun 30, 2024Updated last year
- BookSim 2.0☆404Jun 24, 2024Updated last year
- A RISC-V BOOM Microarchitecture Power Modeling Framework☆31May 12, 2023Updated 2 years ago
- The wafer-native AI accelerator simulation platform and inference engine.☆50Jan 1, 2026Updated 2 months ago
- Predict the performance of LLM inference services☆21Sep 18, 2025Updated 5 months ago
- ☆14Oct 11, 2024Updated last year
- ☆19Jun 1, 2023Updated 2 years ago