Alternatives and similar repositories for BATCH

Users that are interested in BATCH are comparing it to the libraries listed below

• TankLabTJU / INFless
  The source code of INFless，a native serverless platform for AI inference.
  ☆47Updated 3 years ago
• msr-fiddle / synergy
  ☆52Updated 3 years ago
• stanford-futuredata / gavel
  Code for "Heterogenity-Aware Cluster Scheduling Policies for Deep Learning Workloads", which appeared at OSDI 2020
  ☆137Updated last year
• All-less / faas-scheduling-benchmark
  A benchmark suite for evaluating FaaS scheduler.
  ☆23Updated 3 years ago
• msr-fiddle / blox
  ☆44Updated last year
• S-Lab-System-Group / HeliosData
  Helios Traces from SenseTime
  ☆61Updated 3 years ago
• S-Lab-System-Group / Lucid
  Lucid: A Non-Intrusive, Scalable and Interpretable Scheduler for Deep Learning Training Jobs
  ☆58Updated 2 years ago
• hkust-adsl / kubernetes-scheduler-simulator
  Kubernetes Scheduler Simulator
  ☆123Updated last year
• MincYu / gillis-open-source
  ☆27Updated 2 years ago
• msr-fiddle / philly-traces
  ☆198Updated 6 years ago
• S-Lab-System-Group / HeliosArtifact
  HeliosArtifact
  ☆22Updated 3 years ago
• icanforce / Orion-OSDI22
  Serverless optimizations
  ☆51Updated last year
• James-QiuHaoran / LLM-serving-with-proxy-models
  Efficient Interactive LLM Serving with Proxy Model-based Sequence Length Prediction | A tiny BERT model can tell you the verbosity of an …
  ☆47Updated last year
• S-Lab-System-Group / Awesome-DL-Scheduling-Papers
  ☆323Updated 2 years ago
• casys-kaist / glet
  ☆53Updated last year
• icloud-ecnu / igniter
  iGniter, an interference-aware GPU resource provisioning framework for achieving predictable performance of DNN inference in the cloud.
  ☆39Updated last year
• uclasystem / bamboo
  Bamboo is a system for running large pipeline-parallel DNNs affordably, reliably, and efficiently using spot instances.
  ☆55Updated 3 years ago
• SymbioticLab / Tiresias
  Tiresias is a GPU cluster manager for distributed deep learning training.
  ☆166Updated 5 years ago
• stanford-mast / INFaaS
  Model-less Inference Serving
  ☆93Updated 2 years ago
• Raphael-Hao / Abacus
  ☆38Updated 7 months ago
• kzhang28 / Optimus
  An Efficient Dynamic Resource Scheduler for Deep Learning Clusters
  ☆41Updated 8 years ago
• uw-mad-dash / shockwave
  Artifact for "Shockwave: Fair and Efficient Cluster Scheduling for Dynamic Adaptation in Machine Learning" [NSDI '23]
  ☆46Updated 3 years ago
• siasosp23 / artifacts
  ☆24Updated 2 years ago
• marcoszh / MArk-Project
  Exploiting Cloud Services for Cost-Effective, SLO-Aware Machine Learning Inference Serving
  ☆37Updated 6 years ago
• microsoft / autothrottle
  Codebase for Autothrottle (NSDI 2024)
  ☆53Updated 2 years ago
• pkusys / ElasticFlow
  Artifacts for our ASPLOS'23 paper ElasticFlow
  ☆55Updated last year
• IntelliSys-Lab / RainbowCake-ASPLOS24
  ☆42Updated 2 years ago
• pkusys / TGS
  Artifacts for our NSDI'23 paper TGS
  ☆94Updated last year
• HPMLL / BurstGPT
  A ChatGPT(GPT-3.5) & GPT-4 Workload Trace to Optimize LLM Serving Systems
  ☆236Updated last week
• pengyanghua / optimus
  A Deep Learning Cluster Scheduler
  ☆37Updated 5 years ago