ranggihwang / Pregated_MoE
☆43Updated 10 months ago
Alternatives and similar repositories for Pregated_MoE:
Users that are interested in Pregated_MoE are comparing it to the libraries listed below
- ☆20Updated 3 months ago
- Open-source of LazyDP published in ASPLOS-2024☆21Updated 10 months ago
- ☆64Updated last week
- [HPCA'24] Smart-Infinity: Fast Large Language Model Training using Near-Storage Processing on a Real System☆41Updated last year
- Tender: Accelerating Large Language Models via Tensor Decompostion and Runtime Requantization (ISCA'24)☆14Updated 8 months ago
- LLMServingSim: A HW/SW Co-Simulation Infrastructure for LLM Inference Serving at Scale☆96Updated last month
- ☆129Updated 9 months ago
- ☆131Updated 2 months ago
- ☆22Updated 4 months ago
- LLM Inference analyzer for different hardware platforms☆55Updated last week
- NeuPIMs: NPU-PIM Heterogeneous Acceleration for Batched LLM Inferencing☆75Updated 9 months ago
- LLM serving cluster simulator☆94Updated 11 months ago
- ☆62Updated 9 months ago
- Proteus: A High-Throughput Inference-Serving System with Accuracy Scaling☆10Updated last year
- ☆53Updated last year
- InfiniGen: Efficient Generative Inference of Large Language Models with Dynamic KV Cache Management (OSDI'24)☆119Updated 8 months ago
- MAGIS: Memory Optimization via Coordinated Graph Transformation and Scheduling for DNN (ASPLOS'24)☆49Updated 10 months ago
- [ACM EuroSys '23] Fast and Efficient Model Serving Using Multi-GPUs with Direct-Host-Access☆57Updated last year
- UPMEM LLM Framework allows profiling PyTorch layers and functions and simulate those layers/functions with a given hardware profile.☆25Updated last month
- ☆19Updated last year
- ☆29Updated 9 months ago
- Artifact for paper "PIM is All You Need: A CXL-Enabled GPU-Free System for LLM Inference", ASPLOS 2025☆41Updated last week
- ☆23Updated 2 years ago
- ☆100Updated 3 weeks ago
- ☆36Updated last year
- A Cycle-level simulator for M2NDP☆25Updated 4 months ago
- Artifact for PPoPP22 QGTC: Accelerating Quantized GNN via GPU Tensor Core.☆27Updated 3 years ago
- ☆32Updated 2 years ago
- ☆94Updated last year
- ArkVale: Efficient Generative LLM Inference with Recallable Key-Value Eviction (NIPS'24)☆32Updated 3 months ago