samialabed / rlcache

Related projects: ⓘ

• llm-db / FineInfer
  Deferred Continuous Batching in Resource-Efficient Large Language Model Serving (EuroMLSys 2024)
  ☆11Updated 3 months ago
• casys-kaist / EnvPipe
  ☆19Updated last year
• S-Lab-System-Group / ChronusArtifact
  ☆19Updated 2 years ago
• sands-lab / omnireduce
  ☆67Updated last year
• qipengwang / Melon
  MobiSys#114
  ☆21Updated last year
• Godric877 / RLCaR
  Reinforcement Learning for Cache admission and Replacement
  ☆10Updated 2 years ago
• S-Lab-System-Group / Awesome-ML-for-System
  SOTA Learning-augmented Systems
  ☆32Updated 2 years ago
• tonyzhao-jt / LLM-PQ
  Official Repo for "LLM-PQ: Serving LLM on Heterogeneous Clusters with Phase-Aware Partition and Adaptive Quantization"
  ☆25Updated 6 months ago
• pengyanghua / DL2
  a deep learning-driven scheduler for elastic training in deep learning clusters
  ☆27Updated 3 years ago
• msr-fiddle / blox
  ☆23Updated 2 months ago
• huaweicloud / trace_generation_rnn
  This repository contains code for the paper: Bergsma S., Zeyl T., Senderovich A., and Beck J. C., "Generating Complex, Realistic Cloud Wo…
  ☆42Updated 2 years ago
• jiazhihao / attention_superoptimizer
  An Attention Superoptimizer
  ☆19Updated 4 months ago
• jay2jaykp / Machine-Learning-on-Cache-Replacement-Policy
  CSC2515 Course Project Fall 2018
  ☆15Updated 5 years ago
• Rivendile / Muri
  Artifacts for our SIGCOMM'22 paper Muri
  ☆38Updated 8 months ago
• pkusys / Auncel
  Vector search with bounded performance.
  ☆33Updated 7 months ago
• WukLab / InferCept
  ☆15Updated 2 months ago
• MincYu / gillis-open-source
  ☆21Updated last year
• awslabs / optimizing-multitask-training-through-dynamic-pipelines
  Official repository for the paper DynaPipe: Optimizing Multi-task Training through Dynamic Pipelines
  ☆13Updated 9 months ago
• chhzh123 / ptc-tutorial
  PyTorch compilation tutorial covering TorchScript, torch.fx, and Slapo
  ☆18Updated last year
• quovadim / RL-Cache
  ☆27Updated 5 years ago
• SymbioticLab / ModelKeeper
  A Cluster-Wide Model Manager to Accelerate DNN Training via Automated Training Warmup
  ☆31Updated last year
• Mutinifni / splitwise-sim
  LLM serving cluster simulator
  ☆55Updated 4 months ago
• zhuangwang93 / Cupcake
  Cupcake: A Compression Scheduler for Scalable Communication-Efficient Distributed Training (MLSys '23)
  ☆8Updated last year
• casys-kaist / LLMServingSim
  LLMServingSim: A HW/SW Co-Simulation Infrastructure for LLM Inference Serving at Scale
  ☆32Updated last month
• ruipeterpan / torch_profiler
  Simple PyTorch profiler that combines DeepSpeed Flops Profiler and TorchInfo
  ☆9Updated last year
• hku-systems / naspipe
  ☆14Updated 2 years ago
• jasperzhong / swift
  ☆13Updated 2 years ago
• bytedance / QSync
  Official resporitory for "IPDPS' 24 QSync: Quantization-Minimized Synchronous Distributed Training Across Hybrid Devices".
  ☆19Updated 6 months ago
• romilbhardwaj / cilantro
  Source code for OSDI 2023 paper titled "Cilantro - Performance-Aware Resource Allocation for General Objectives via Online Feedback"
  ☆37Updated last year