samialabed / rlcache
Cache Manager using Reinforcement Learning
☆9Updated 5 years ago
Alternatives and similar repositories for rlcache:
Users that are interested in rlcache are comparing it to the libraries listed below
- MobiSys#114☆21Updated last year
- ☆69Updated last year
- Official resporitory for "IPDPS' 24 QSync: Quantization-Minimized Synchronous Distributed Training Across Hybrid Devices".☆19Updated 10 months ago
- A Cluster-Wide Model Manager to Accelerate DNN Training via Automated Training Warmup☆34Updated 2 years ago
- Multi-Instance-GPU profiling tool☆56Updated last year
- Vector search with bounded performance.☆34Updated 11 months ago
- a deep learning-driven scheduler for elastic training in deep learning clusters☆28Updated 4 years ago
- ☆11Updated 9 months ago
- ☆20Updated 3 years ago
- SOTA Learning-augmented Systems☆34Updated 2 years ago
- A Deep Learning Cluster Scheduler☆37Updated 4 years ago
- Experimental deep learning framework written in Rust☆14Updated 2 years ago
- Artifact for "Apparate: Rethinking Early Exits to Tame Latency-Throughput Tensions in ML Serving" [SOSP '24]☆22Updated last month
- Tiresias is a GPU cluster manager for distributed deep learning training.☆151Updated 4 years ago
- ☆35Updated 6 months ago
- PetPS: Supporting Huge Embedding Models with Tiered Memory☆30Updated 7 months ago
- PipeTransformer: Automated Elastic Pipelining for Distributed Training of Large-scale Models. ICML 2021☆55Updated 3 years ago
- Official Repo for "LLM-PQ: Serving LLM on Heterogeneous Clusters with Phase-Aware Partition and Adaptive Quantization"☆29Updated 10 months ago
- A version of XRBench-MAESTRO used for MLSys 2023 publication☆23Updated last year
- Reinforcement Learning for Cache admission and Replacement☆11Updated 2 years ago
- ☆16Updated 2 years ago
- ☆48Updated 2 years ago
- ☆33Updated 2 years ago
- PipeSwitch: Fast Pipelined Context Switching for Deep Learning Applications☆126Updated 2 years ago
- ☆24Updated last year
- ☆28Updated 5 years ago
- An Attention Superoptimizer☆20Updated 8 months ago
- Source code for OSDI 2023 paper titled "Cilantro - Performance-Aware Resource Allocation for General Objectives via Online Feedback"☆38Updated last year
- Simple PyTorch profiler that combines DeepSpeed Flops Profiler and TorchInfo☆9Updated last year