ranggihwang / Pregated_MoE
☆33Updated 6 months ago
Related projects ⓘ
Alternatives and complementary repositories for Pregated_MoE
- ☆39Updated last month
- Open-source of LazyDP published in ASPLOS-2024☆21Updated 6 months ago
- ☆100Updated last month
- NeuPIMs Simulator☆54Updated 5 months ago
- Tender: Accelerating Large Language Models via Tensor Decompostion and Runtime Requantization (ISCA'24)☆12Updated 4 months ago
- ☆40Updated 4 months ago
- [HPCA'24] Smart-Infinity: Fast Large Language Model Training using Near-Storage Processing on a Real System☆36Updated 8 months ago
- ☆18Updated 5 months ago
- LLMServingSim: A HW/SW Co-Simulation Infrastructure for LLM Inference Serving at Scale☆58Updated 3 weeks ago
- ☆87Updated 4 months ago
- LLM serving cluster simulator☆81Updated 6 months ago
- LLM Inference analyzer for different hardware platforms☆42Updated this week
- InfiniGen: Efficient Generative Inference of Large Language Models with Dynamic KV Cache Management (OSDI'24)☆79Updated 4 months ago
- ☆80Updated last year
- PIM-DL: Expanding the Applicability of Commodity DRAM-PIMs for Deep Learning via Algorithm-System Co-Optimization☆25Updated 9 months ago
- ☆23Updated 2 years ago
- Processing-In-Memory (PIM) Simulator☆132Updated 4 months ago
- ONNXim is a fast cycle-level simulator that can model multi-core NPUs for DNN inference☆67Updated last week
- PALM: A Efficient Performance Simulator for Tiled Accelerators with Large-scale Model Training☆13Updated 5 months ago
- ☆20Updated this week
- ☆17Updated last year
- ☆11Updated 10 months ago
- mNPUsim: A Cycle-accurate Multi-core NPU Simulator (IISWC 2023)☆38Updated 6 months ago
- ArkVale: Efficient Generative LLM Inference with Recallable Key-Value Eviction (NIPS'24)☆17Updated last week
- ☆33Updated last year
- ☆82Updated this week
- MAGIS: Memory Optimization via Coordinated Graph Transformation and Scheduling for DNN (ASPLOS'24)☆44Updated 5 months ago
- ☆60Updated 3 years ago
- MultiPIM: A Detailed and Configurable Multi-Stack Processing-In-Memory Simulator☆51Updated 3 years ago
- ☆22Updated last year