VIA-Research / vTrainLinks
☆70Updated last month
Alternatives and similar repositories for vTrain
Users that are interested in vTrain are comparing it to the libraries listed below
Sorting:
- LLMServingSim: A HW/SW Co-Simulation Infrastructure for LLM Inference Serving at Scale☆119Updated last week
- ☆48Updated last year
- Open-source of LazyDP published in ASPLOS-2024☆22Updated last year
- ☆20Updated 5 months ago
- ☆25Updated last year
- [ACM EuroSys '23] Fast and Efficient Model Serving Using Multi-GPUs with Direct-Host-Access☆56Updated last year
- ☆143Updated 4 months ago
- NeuPIMs: NPU-PIM Heterogeneous Acceleration for Batched LLM Inferencing☆83Updated last year
- [HPCA'24] Smart-Infinity: Fast Large Language Model Training using Near-Storage Processing on a Real System☆46Updated last year
- A Cycle-level simulator for M2NDP☆28Updated last month
- LLM serving cluster simulator☆106Updated last year
- ☆24Updated 6 months ago
- LLM Inference analyzer for different hardware platforms☆74Updated 3 weeks ago
- UPMEM LLM Framework allows profiling PyTorch layers and functions and simulate those layers/functions with a given hardware profile.☆30Updated 3 weeks ago
- Tender: Accelerating Large Language Models via Tensor Decompostion and Runtime Requantization (ISCA'24)☆16Updated 11 months ago
- ☆75Updated last year
- ☆11Updated last month
- ☆154Updated 11 months ago
- ☆42Updated this week
- ☆59Updated last year
- Artifact for paper "PIM is All You Need: A CXL-Enabled GPU-Free System for LLM Inference", ASPLOS 2025☆71Updated last month
- PIM-DL: Expanding the Applicability of Commodity DRAM-PIMs for Deep Learning via Algorithm-System Co-Optimization☆31Updated last year
- Proteus: A High-Throughput Inference-Serving System with Accuracy Scaling☆13Updated last year
- ☆23Updated 2 years ago
- Processing-In-Memory (PIM) Simulator☆169Updated 6 months ago
- ☆25Updated 2 years ago
- ☆38Updated 2 years ago
- ☆62Updated last year
- A Vectorized N:M Format for Unleashing the Power of Sparse Tensor Cores☆51Updated last year
- PyTorch-UVM on super-large language models.☆16Updated 4 years ago