EMDC-OS / power-aware-triton
Know Your Enemy To Save Cloud Energy: Energy-Performance Characterization of Machine Learning Serving (HPCA '23)
☆13Updated last month
Alternatives and similar repositories for power-aware-triton:
Users that are interested in power-aware-triton are comparing it to the libraries listed below
- ☆9Updated last month
- Intel staging area for llvm.org contribution. Home for Intel LLVM-based projects.☆38Updated last month
- Fast and Efficient Model Serving Using Multi-GPUs with Direct-Host-Access (ACM EuroSys '23)☆55Updated 10 months ago
- LLMServingSim: A HW/SW Co-Simulation Infrastructure for LLM Inference Serving at Scale☆83Updated last month
- MISO: Exploiting Multi-Instance GPU Capability on Multi-Tenant GPU Clusters☆17Updated last year
- ☆37Updated 3 years ago
- LLM serving cluster simulator☆92Updated 9 months ago
- ☆44Updated last month
- ☆24Updated last year
- TACCL: Guiding Collective Algorithm Synthesis using Communication Sketches☆69Updated last year
- Repository for MLCommons Chakra schema and tools☆84Updated 3 weeks ago
- ☆24Updated last week
- ☆23Updated 2 years ago
- ☆48Updated last month
- Proteus: A High-Throughput Inference-Serving System with Accuracy Scaling☆10Updated 11 months ago
- ☆39Updated 9 months ago
- ☆23Updated 3 years ago
- Hi-Speed DNN Training with Espresso: Unleashing the Full Potential of Gradient Compression with Near-Optimal Usage Strategies (EuroSys '2…☆15Updated last year
- [NSDI 2023] TopoOpt: Optimizing the Network Topology for Distributed DNN Training☆27Updated 5 months ago
- ☆35Updated last year
- Network Contention-Aware Cluster Scheduling with Reinforcement Learning (IEEE ICPADS 2023)☆15Updated 4 months ago
- Synthesizer for optimal collective communication algorithms☆103Updated 10 months ago
- ☆75Updated 2 years ago
- "JABAS: Joint Adaptive Batching and Automatic Scaling for DNN Training on Heterogeneous GPUs" (EuroSys '25)☆12Updated 3 weeks ago
- ☆12Updated 4 months ago
- ☆21Updated 2 months ago
- Repository for MLCommons Chakra schema and tools☆39Updated last year
- NeuPIMs Simulator☆70Updated 8 months ago
- PyTorch-UVM on super-large language models.☆15Updated 4 years ago
- Exploring the Design Space of Page Management for Multi-Tiered Memory Systems (USENIX ATC '21)☆43Updated 2 years ago