ranggihwang / Pregated_MoE
☆45Updated 11 months ago
Alternatives and similar repositories for Pregated_MoE:
Users that are interested in Pregated_MoE are comparing it to the libraries listed below
- ☆66Updated 3 weeks ago
- ☆20Updated 3 months ago
- Open-source of LazyDP published in ASPLOS-2024☆21Updated 11 months ago
- Tender: Accelerating Large Language Models via Tensor Decompostion and Runtime Requantization (ISCA'24)☆14Updated 9 months ago
- ☆23Updated 4 months ago
- [HPCA'24] Smart-Infinity: Fast Large Language Model Training using Near-Storage Processing on a Real System☆42Updated last year
- NeuPIMs: NPU-PIM Heterogeneous Acceleration for Batched LLM Inferencing☆79Updated 10 months ago
- ☆133Updated 2 months ago
- LLMServingSim: A HW/SW Co-Simulation Infrastructure for LLM Inference Serving at Scale☆109Updated last month
- ☆137Updated 9 months ago
- LLM Inference analyzer for different hardware platforms☆62Updated 2 weeks ago
- ☆54Updated last year
- Artifact for paper "PIM is All You Need: A CXL-Enabled GPU-Free System for LLM Inference", ASPLOS 2025☆49Updated last month
- ☆19Updated last year
- UPMEM LLM Framework allows profiling PyTorch layers and functions and simulate those layers/functions with a given hardware profile.☆27Updated this week
- ☆64Updated 9 months ago
- MAGIS: Memory Optimization via Coordinated Graph Transformation and Scheduling for DNN (ASPLOS'24)☆50Updated 10 months ago
- ☆29Updated 10 months ago
- ArkVale: Efficient Generative LLM Inference with Recallable Key-Value Eviction (NIPS'24)☆36Updated 4 months ago
- ☆12Updated 3 weeks ago
- LLM serving cluster simulator☆96Updated 11 months ago
- SpInfer: Leveraging Low-Level Sparsity for Efficient Large Language Model Inference on GPUs☆42Updated 3 weeks ago
- ☆94Updated last year
- A Cycle-level simulator for M2NDP☆26Updated 4 months ago
- PIM-DL: Expanding the Applicability of Commodity DRAM-PIMs for Deep Learning via Algorithm-System Co-Optimization☆29Updated last year
- Sharing the codebase and steps for artifact evaluation/reproduction for MICRO 2024 paper☆9Updated 7 months ago
- InfiniGen: Efficient Generative Inference of Large Language Models with Dynamic KV Cache Management (OSDI'24)☆122Updated 9 months ago
- ☆30Updated 2 months ago
- ☆24Updated last year
- Proteus: A High-Throughput Inference-Serving System with Accuracy Scaling☆10Updated last year