Alternatives and similar repositories for torpor

Users that are interested in torpor are comparing it to the libraries listed below

• mental2008 / awesome-papers
  Here are my personal paper reading notes (including cloud computing, resource management, systems, machine learning, deep learning, and o…
  ☆141Updated last month
• eth-easl / orion
  An interference-aware scheduler for fine-grained GPU sharing
  ☆154Updated 3 weeks ago
• Hsword / SpotServe
  SpotServe: Serving Generative Large Language Models on Preemptible Instances
  ☆133Updated last year
• WukLab / preble
  Stateful LLM Serving
  ☆90Updated 9 months ago
• msr-fiddle / blox
  ☆44Updated last year
• microsoft / tokenweave
  Efficient Compute-Communication Overlap for Distributed LLM Inference
  ☆66Updated last month
• alibaba / ServeGen
  A framework for generating realistic LLM serving workloads
  ☆93Updated 2 months ago
• NetX-lab / Echo-slowdown
  Slowdown prediction module of Echo: Simulating Distributed Training at Scale
  ☆13Updated 7 months ago
• SJTU-IPADS / PhoenixOS
  Fast OS-level support for GPU checkpoint and restore
  ☆264Updated 2 months ago
• UChi-JCL / CacheGen
  ☆144Updated last year
• pkusys / TGS
  Artifacts for our NSDI'23 paper TGS
  ☆93Updated last year
• pkusys / Auncel
  Vector search with bounded performance.
  ☆35Updated last year
• tyler-griggs / melange-release
  ☆48Updated last year
• eth-easl / pccheck
  ☆12Updated last year
• aliyun / aicb
  ☆227Updated 2 weeks ago
• hao-ai-lab / MuxServe
  ☆80Updated 2 months ago
• SJTU-IPADS / PhoenixOS-Remoting
  ☆21Updated 5 months ago
• SJTU-IPADS / reef
  REEF is a GPU-accelerated DNN inference serving system that enables instant kernel preemption and biased concurrent execution in GPU sche…
  ☆102Updated 3 years ago
• msr-fiddle / CheckFreq
  ☆56Updated 4 years ago
• NetX-lab / Echo
  Simulating Distributed Training at Scale
  ☆14Updated 3 months ago
• quiver-team / quiver-feature
  High performance RDMA-based distributed feature collection component for training GNN model on EXTREMELY large graph
  ☆56Updated 3 years ago
• hongzhangblaze / CS854-F24
  ☆54Updated 3 months ago
• netx-repo / training-bottleneck
  Analyze network performance in distributed training
  ☆19Updated 5 years ago
• S-Lab-System-Group / Awesome-DL-Scheduling-Papers
  ☆317Updated last year
• eddiegaoo / Apt-Serve
  ☆20Updated 6 months ago
• uw-mad-dash / shockwave
  Artifact for "Shockwave: Fair and Efficient Cluster Scheduling for Dynamic Adaptation in Machine Learning" [NSDI '23]
  ☆46Updated 3 years ago
• pkusys / ElasticFlow
  Artifacts for our ASPLOS'23 paper ElasticFlow
  ☆55Updated last year
• TankLabTJU / INFless
  The source code of INFless，a native serverless platform for AI inference.
  ☆44Updated 3 years ago
• lambda7xx / awesome-AI-system
  paper and its code for AI System
  ☆341Updated last week
• Sys-KU / DeepPlan
  [ACM EuroSys 2023] Fast and Efficient Model Serving Using Multi-GPUs with Direct-Host-Access
  ☆56Updated 4 months ago