pku-liang / ArkVale
ArkVale: Efficient Generative LLM Inference with Recallable Key-Value Eviction (NIPS'24)
☆16Updated 2 weeks ago
Related projects ⓘ
Alternatives and complementary repositories for ArkVale
- MAGIS: Memory Optimization via Coordinated Graph Transformation and Scheduling for DNN (ASPLOS'24)☆43Updated 5 months ago
- TileFlow is a performance analysis tool based on Timeloop for fusion dataflows☆55Updated 7 months ago
- PIM-DL: Expanding the Applicability of Commodity DRAM-PIMs for Deep Learning via Algorithm-System Co-Optimization☆25Updated 8 months ago
- ☆83Updated 4 months ago
- The Artifact of NeoMem: Hardware/Software Co-Design for CXL-Native Memory Tiering☆27Updated 3 months ago
- Repository for artifact evaluation of ASPLOS 2023 paper "SparseTIR: Composable Abstractions for Sparse Compilation in Deep Learning"☆23Updated last year
- [HPCA'24] Smart-Infinity: Fast Large Language Model Training using Near-Storage Processing on a Real System☆34Updated 8 months ago
- ☆14Updated 3 years ago
- ☆22Updated last year
- DOSA: Differentiable Model-Based One-Loop Search for DNN Accelerators☆14Updated last month
- ☆25Updated 3 years ago
- NeuPIMs Simulator☆51Updated 4 months ago
- ☆9Updated last year
- Tender: Accelerating Large Language Models via Tensor Decompostion and Runtime Requantization (ISCA'24)☆12Updated 4 months ago
- Domain-Specific Architecture Generator 2☆20Updated 2 years ago
- A scheduler for spatial DNN accelerators that generate high-performance schedules in one shot using mixed integer programming (MIP)☆74Updated last year
- Artifact evaluation of PLDI'24 paper "Allo: A Programming Model for Composable Accelerator Design"☆15Updated 7 months ago
- ☆82Updated 5 months ago
- agile hardware-software co-design☆45Updated 2 years ago
- LLM Inference analyzer for different hardware platforms☆42Updated this week
- An analytical framework that models hardware dataflow of tensor applications on spatial architectures using the relation-centric notation…☆81Updated 6 months ago
- The simulator for SPADA, an SpGEMM accelerator with adaptive dataflow☆28Updated last year
- ☆21Updated last year
- ONNXim is a fast cycle-level simulator that can model multi-core NPUs for DNN inference☆62Updated 2 months ago
- ☆9Updated 5 months ago
- ☆80Updated 11 months ago
- The official code for DATE'23 paper <CLAP: Locality Aware and Parallel Triangle Counting with Content Addressable Memory>☆20Updated last month
- ☆60Updated 3 years ago
- Artifact for OSDI'23: MGG: Accelerating Graph Neural Networks with Fine-grained intra-kernel Communication-Computation Pipelining on Mult…☆37Updated 7 months ago
- Codebase for ICML'24 paper: Learning from Students: Applying t-Distributions to Explore Accurate and Efficient Formats for LLMs☆24Updated 4 months ago