fredrickang / LaLaRANDLinks
LaLaRAND: Flexible Layer-by-Layer CPU/GPU Scheduling for Real-Time DNN Tasks
☆15Updated 3 years ago
Alternatives and similar repositories for LaLaRAND
Users that are interested in LaLaRAND are comparing it to the libraries listed below
Sorting:
- LLMServingSim: A HW/SW Co-Simulation Infrastructure for LLM Inference Serving at Scale☆146Updated 3 months ago
- ☆38Updated 4 months ago
- Multi-DNN Inference Engine for Heterogeneous Mobile Processors☆35Updated last year
- Proteus: A High-Throughput Inference-Serving System with Accuracy Scaling☆13Updated last year
- [ACM EuroSys 2023] Fast and Efficient Model Serving Using Multi-GPUs with Direct-Host-Access☆57Updated 3 months ago
- Source code for the paper: "A Latency-Predictable Multi-Dimensional Optimization Framework forDNN-driven Autonomous Systems"☆22Updated 4 years ago
- ☆78Updated 2 years ago
- iGniter, an interference-aware GPU resource provisioning framework for achieving predictable performance of DNN inference in the cloud.☆38Updated last year
- ☆53Updated 10 months ago
- ☆73Updated 5 months ago
- ☆27Updated 11 months ago
- ☆199Updated 2 weeks ago
- ☆24Updated 3 years ago
- NeuPIMs: NPU-PIM Heterogeneous Acceleration for Batched LLM Inferencing☆98Updated last year
- zTT: Learning-based DVFS with Zero Thermal Throttling for Mobile Devices [MobiSys'21] - Artifact Evaluation☆26Updated 4 years ago
- This is a list of awesome edgeAI inference related papers.☆99Updated last year
- ☆156Updated last year
- ☆51Updated 2 years ago
- ☆40Updated 2 years ago
- LLM serving cluster simulator☆116Updated last year
- ☆18Updated last week
- PIM-DL: Expanding the Applicability of Commodity DRAM-PIMs for Deep Learning via Algorithm-System Co-Optimization☆33Updated last year
- [PACT'24] GraNNDis. A fast and unified distributed graph neural network (GNN) training framework for both full-batch (full-graph) and min…☆10Updated last year
- This repository is established to store personal notes and annotated papers during daily research.☆157Updated last week
- MISO: Exploiting Multi-Instance GPU Capability on Multi-Tenant GPU Clusters☆20Updated 2 years ago
- ☆13Updated 7 months ago
- ASTRA-sim2.0: Modeling Hierarchical Networks and Disaggregated Systems for Large-model Training at Scale☆459Updated this week
- LLM Inference analyzer for different hardware platforms☆94Updated 4 months ago
- ☆156Updated 9 months ago
- MAGIS: Memory Optimization via Coordinated Graph Transformation and Scheduling for DNN (ASPLOS'24)☆55Updated last year