Alternatives and similar repositories for Medusa

Users that are interested in Medusa are comparing it to the libraries listed below

• alibaba-edu / qwen-bailian-usagetraces-anon
  ☆26Updated last month
• dmemsys / Aceso
  This is the implementation repository of our SOSP'24 paper: Aceso: Achieving Efficient Fault Tolerance in Memory-Disaggregated Key-Value …
  ☆21Updated 8 months ago
• thustorage / PetPS
  PetPS: Supporting Huge Embedding Models with Tiered Memory
  ☆31Updated last year
• WukLab / Mira
  A Progam-Behavior-Guided Far Memory System
  ☆35Updated last year
• csl-iisc / GPM-ASPLOS22
  ☆36Updated last year
• BLepers / JohnnyCache
  Johnny Cache: the End of DRAM Cache Conflicts (in Tiered Main Memory Systems)
  ☆18Updated last year
• Thesys-lab / Helix-ASPLOS25
  Open-source implementation for "Helix: Serving Large Language Models over Heterogeneous GPUs and Network via Max-Flow"
  ☆53Updated 7 months ago
• msr-fiddle / CheckFreq
  ☆54Updated 4 years ago
• uclasystem / bamboo
  Bamboo is a system for running large pipeline-parallel DNNs affordably, reliably, and efficiently using spot instances.
  ☆50Updated 2 years ago
• jasperzhong / swift
  ☆14Updated 3 years ago
• dywsjtu / apparate
  Artifact for "Apparate: Rethinking Early Exits to Tame Latency-Throughput Tensions in ML Serving" [SOSP '24]
  ☆25Updated 7 months ago
• SJTU-IPADS / reef
  REEF is a GPU-accelerated DNN inference serving system that enables instant kernel preemption and biased concurrent execution in GPU sche…
  ☆95Updated 2 years ago
• Nu-NSDI23 / Nu
  Nu is a new datacenter system that enables developers to build fungible applications that can use datacenter resources wherever they are.
  ☆39Updated last year
• thustorage / deft
  Deft: A Scalable Tree Index for Disaggregated Memory
  ☆18Updated 2 months ago
• uclasystem / canvas
  Canvas: Isolated and Adaptive Swapping for Multi-Applications on Remote Memory
  ☆38Updated 2 years ago
• chaojin0310 / Ditto
  Artifacts for our SIGCOMM'23 paper Ditto
  ☆15Updated last year
• sysartifacts / sysartifacts.github.io
  Website for Artifact Evaluation at EuroSys, SOSP, OSDI, ATC
  ☆44Updated last month
• madsys-dev / smart
  Scaling Up Memory Disaggregated Applications with SMART
  ☆28Updated last year
• James-QiuHaoran / LLM-serving-with-proxy-models
  Efficient Interactive LLM Serving with Proxy Model-based Sequence Length Prediction | A tiny BERT model can tell you the verbosity of an …
  ☆36Updated last year
• SJTU-IPADS / ugache
  ☆22Updated last year
• romilbhardwaj / cilantro
  Source code for OSDI 2023 paper titled "Cilantro - Performance-Aware Resource Allocation for General Objectives via Online Feedback"
  ☆39Updated 2 years ago
• uw-mad-dash / shockwave
  Artifact for "Shockwave: Fair and Efficient Cluster Scheduling for Dynamic Adaptation in Machine Learning" [NSDI '23]
  ☆44Updated 2 years ago
• utnslab / Medes
  Deduplication over dis-aggregated memory for Serverless Computing
  ☆13Updated 3 years ago
• TankLabTJU / INFless
  The source code of INFless，a native serverless platform for AI inference.
  ☆39Updated 2 years ago
• Sys-KU / AutoTiering
  [USENIX ATC 2021] Exploring the Design Space of Page Management for Multi-Tiered Memory Systems
  ☆47Updated 3 years ago
• madsys-dev / sosp-paper19-ae
  The Artifact Evaluation Version of SOSP Paper #19
  ☆48Updated 10 months ago
• rkhan055 / SHADE
  SHADE: Enable Fundamental Cacheability for Distributed Deep Learning Training
  ☆35Updated 2 years ago
• Hsword / Awesome-Machine-Learning-System-Papers
  ☆72Updated 3 years ago
• minghust / motor
  [OSDI 2024] Motor: Enabling Multi-Versioning for Distributed Transactions on Disaggregated Memory
  ☆49Updated last year
• LLMServe / dLoRA-artifact
  ☆23Updated last year