PDZZXL / Awesome-LLM-ServingLinks
Large Language Model (LLM) Serving Paper and Resource List
☆23Updated last month
Alternatives and similar repositories for Awesome-LLM-Serving
Users that are interested in Awesome-LLM-Serving are comparing it to the libraries listed below
Sorting:
- ☆154Updated 11 months ago
- ☆11Updated 9 months ago
- ☆110Updated 2 weeks ago
- NeuPIMs: NPU-PIM Heterogeneous Acceleration for Batched LLM Inferencing☆83Updated last year
- LLM Inference analyzer for different hardware platforms☆73Updated 3 weeks ago
- ☆42Updated this week
- MAGIS: Memory Optimization via Coordinated Graph Transformation and Scheduling for DNN (ASPLOS'24)☆52Updated last year
- ☆73Updated last year
- TileFlow is a performance analysis tool based on Timeloop for fusion dataflows☆61Updated last year
- LLM serving cluster simulator☆106Updated last year
- ☆36Updated last year
- ☆101Updated last year
- This repository is established to store personal notes and annotated papers during daily research.☆128Updated this week
- Open-source Framework for HPCA2024 paper: Gemini: Mapping and Architecture Co-exploration for Large-scale DNN Chiplet Accelerators☆81Updated last month
- Github repository of HPCA 2025 paper "UniNDP: A Unified Compilation and Simulation Tool for Near DRAM Processing Architectures"☆13Updated 6 months ago
- Artifact for paper "PIM is All You Need: A CXL-Enabled GPU-Free System for LLM Inference", ASPLOS 2025☆71Updated last month
- OSDI 2023 Welder, deeplearning compiler☆20Updated last year
- ☆21Updated last year
- The framework for the paper "Inter-layer Scheduling Space Definition and Exploration for Tiled Accelerators" in ISCA 2023.☆68Updated 3 months ago
- ☆31Updated last year
- HyFiSS: A Hybrid Fidelity Stall-Aware Simulator for GPGPUs☆34Updated 6 months ago
- LIBRA: Enabling Workload-aware Multi-dimensional Network Topology Optimization for Distributed Training of Large AI Models☆11Updated last year
- TACOS: [T]opology-[A]ware [Co]llective Algorithm [S]ynthesizer for Distributed Machine Learning☆23Updated last week
- ☆18Updated last year
- ☆48Updated last year
- An Optimizing Framework on MLIR for Efficient FPGA-based Accelerator Generation☆44Updated last year
- Automatic Mapping Generation, Verification, and Exploration for ISA-based Spatial Accelerators☆112Updated 2 years ago
- UPMEM LLM Framework allows profiling PyTorch layers and functions and simulate those layers/functions with a given hardware profile.☆30Updated 3 weeks ago
- PALM: A Efficient Performance Simulator for Tiled Accelerators with Large-scale Model Training☆16Updated last year
- REEF is a GPU-accelerated DNN inference serving system that enables instant kernel preemption and biased concurrent execution in GPU sche…☆94Updated 2 years ago