PDZZXL / Awesome-LLM-Serving
Large Language Model (LLM) Serving Paper and Resource List
☆21Updated 7 months ago
Alternatives and similar repositories for Awesome-LLM-Serving:
Users that are interested in Awesome-LLM-Serving are comparing it to the libraries listed below
- ☆138Updated 9 months ago
- ☆104Updated last week
- LLM serving cluster simulator☆97Updated last year
- ☆11Updated 7 months ago
- MAGIS: Memory Optimization via Coordinated Graph Transformation and Scheduling for DNN (ASPLOS'24)☆50Updated 10 months ago
- NeuPIMs: NPU-PIM Heterogeneous Acceleration for Batched LLM Inferencing☆80Updated 10 months ago
- Automatic Mapping Generation, Verification, and Exploration for ISA-based Spatial Accelerators☆108Updated 2 years ago
- ☆34Updated 2 months ago
- ☆36Updated last year
- Artifact for paper "PIM is All You Need: A CXL-Enabled GPU-Free System for LLM Inference", ASPLOS 2025☆49Updated last month
- The framework for the paper "Inter-layer Scheduling Space Definition and Exploration for Tiled Accelerators" in ISCA 2023.☆67Updated last month
- SC'22 Artifacts Evaluation☆9Updated 2 years ago
- ☆19Updated last year
- Open-source Framework for HPCA2024 paper: Gemini: Mapping and Architecture Co-exploration for Large-scale DNN Chiplet Accelerators☆79Updated 3 weeks ago
- PALM: A Efficient Performance Simulator for Tiled Accelerators with Large-scale Model Training☆16Updated 10 months ago
- LLM Inference analyzer for different hardware platforms☆62Updated 2 weeks ago
- ☆64Updated 10 months ago
- TileFlow is a performance analysis tool based on Timeloop for fusion dataflows☆57Updated last year
- ☆78Updated 2 years ago
- HyFiSS: A Hybrid Fidelity Stall-Aware Simulator for GPGPUs☆29Updated 4 months ago
- PIM-DL: Expanding the Applicability of Commodity DRAM-PIMs for Deep Learning via Algorithm-System Co-Optimization☆29Updated last year
- OSDI 2023 Welder, deeplearning compiler☆19Updated last year
- An analytical framework that models hardware dataflow of tensor applications on spatial architectures using the relation-centric notation…☆84Updated 11 months ago
- ☆29Updated 10 months ago
- Compiler for Dynamic Neural Networks☆46Updated last year
- An Optimizing Framework on MLIR for Efficient FPGA-based Accelerator Generation☆44Updated last year
- ☆35Updated 9 months ago
- Artifact for PPoPP22 QGTC: Accelerating Quantized GNN via GPU Tensor Core.☆27Updated 3 years ago
- This repository is established to store personal notes and annotated papers during daily research.☆117Updated this week
- ☆95Updated last year