AIS-SNU / Smart-Infinity
[HPCA'24] Smart-Infinity: Fast Large Language Model Training using Near-Storage Processing on a Real System
☆38Updated 10 months ago
Alternatives and similar repositories for Smart-Infinity:
Users that are interested in Smart-Infinity are comparing it to the libraries listed below
- PIM-DL: Expanding the Applicability of Commodity DRAM-PIMs for Deep Learning via Algorithm-System Co-Optimization☆27Updated 10 months ago
- ☆21Updated last month
- NeuPIMs Simulator☆65Updated 7 months ago
- UPMEM LLM Framework allows profiling PyTorch layers and functions and simulate those layers/functions with a given hardware profile.☆16Updated last month
- Tender: Accelerating Large Language Models via Tensor Decompostion and Runtime Requantization (ISCA'24)☆13Updated 6 months ago
- ☆37Updated 8 months ago
- ☆45Updated 2 weeks ago
- LLMServingSim: A HW/SW Co-Simulation Infrastructure for LLM Inference Serving at Scale☆78Updated 2 weeks ago
- ☆11Updated last week
- ☆104Updated 6 months ago
- The Artifact of NeoMem: Hardware/Software Co-Design for CXL-Native Memory Tiering☆39Updated 5 months ago
- A Cycle-level simulator for M2NDP☆22Updated last month
- InfiniGen: Efficient Generative Inference of Large Language Models with Dynamic KV Cache Management (OSDI'24)☆100Updated 6 months ago
- ☆35Updated last year
- ☆48Updated 6 months ago
- MAGIS: Memory Optimization via Coordinated Graph Transformation and Scheduling for DNN (ASPLOS'24)☆49Updated 7 months ago
- LLM Inference analyzer for different hardware platforms☆47Updated last month
- ☆85Updated last year
- ArkVale: Efficient Generative LLM Inference with Recallable Key-Value Eviction (NIPS'24)☆24Updated last month
- ☆17Updated last year
- ☆62Updated 3 years ago
- A Full-System Simulator for CXL-Based SSD Memory System☆11Updated 3 weeks ago
- ☆33Updated 2 years ago
- ☆47Updated 9 months ago
- mNPUsim: A Cycle-accurate Multi-core NPU Simulator (IISWC 2023)☆44Updated last month
- ☆24Updated last year
- ☆18Updated 10 months ago
- ☆11Updated 7 months ago
- SimplePIM is the first high-level programming framework for real-world processing-in-memory (PIM) architectures. Described in the PACT 20…☆26Updated last year
- LLM serving cluster simulator☆89Updated 8 months ago