EMDC-OS / power-aware-triton
Know Your Enemy To Save Cloud Energy: Energy-Performance Characterization of Machine Learning Serving (HPCA '23)
☆14Updated 9 months ago
Related projects: ⓘ
- Intel staging area for llvm.org contribution. Home for Intel LLVM-based projects.☆37Updated 9 months ago
- ☆10Updated 8 months ago
- Fast and Efficient Model Serving Using Multi-GPUs with Direct-Host-Access (ACM EuroSys '23)☆51Updated 5 months ago
- ☆40Updated last year
- ☆22Updated 2 years ago
- ☆16Updated 3 months ago
- ☆23Updated 2 years ago
- ☆101Updated last year
- FastFlow is a system that automatically detects CPU bottlenecks in deep learning training pipelines and resolves the bottlenecks with dat…☆25Updated last year
- Dotfile management with bare git☆18Updated 2 weeks ago
- TACCL: Guiding Collective Algorithm Synthesis using Communication Sketches☆54Updated last year
- LLMServingSim: A HW/SW Co-Simulation Infrastructure for LLM Inference Serving at Scale☆32Updated last month
- Repository for MLCommons Chakra schema and tools☆55Updated 2 weeks ago
- NeuPIMs Simulator☆43Updated 3 months ago
- Curated collection of papers in machine learning systems☆123Updated last month
- ☆32Updated last year
- ☆37Updated 2 years ago
- ☆80Updated 3 weeks ago
- PyTorch-UVM on super-large language models.☆13Updated 3 years ago
- ☆27Updated 4 months ago
- An interference-aware scheduler for fine-grained GPU sharing☆92Updated 4 months ago
- Processing-In-Memory (PIM) Simulator☆107Updated 2 months ago
- ☆24Updated 4 years ago
- [NSDI 2023] TopoOpt: Optimizing the Network Topology for Distributed DNN Training☆26Updated last week
- Code for "Heterogenity-Aware Cluster Scheduling Policies for Deep Learning Workloads", which appeared at OSDI 2020☆124Updated last month
- LLM serving cluster simulator☆55Updated 4 months ago
- Tensors and Dynamic neural networks in Python with strong GPU acceleration☆12Updated 3 years ago
- Network Contention-Aware Cluster Scheduling with Reinforcement Learning (IEEE ICPADS 2023)☆14Updated 9 months ago
- A LogGOPS (LogP, LogGP, LogGPS) Simulator and Simulation Framework☆10Updated last month
- ☆34Updated 3 years ago