Alternatives and similar repositories for hivemind-multi-cloud

Users that are interested in hivemind-multi-cloud are comparing it to the libraries listed below

• dywsjtu / apparate
  Artifact for "Apparate: Rethinking Early Exits to Tame Latency-Throughput Tensions in ML Serving" [SOSP '24]
  ☆25Updated 7 months ago
• SymbioticLab / ModelKeeper
  A Cluster-Wide Model Manager to Accelerate DNN Training via Automated Training Warmup
  ☆35Updated 2 years ago
• casys-kaist / EnvPipe
  ☆25Updated last year
• uclasystem / bamboo
  Bamboo is a system for running large pipeline-parallel DNNs affordably, reliably, and efficiently using spot instances.
  ☆50Updated 2 years ago
• uw-mad-dash / shockwave
  Artifact for "Shockwave: Fair and Efficient Cluster Scheduling for Dynamic Adaptation in Machine Learning" [NSDI '23]
  ☆44Updated 2 years ago
• S-Lab-System-Group / ChronusArtifact
  ☆21Updated 3 years ago
• pkusys / ElasticFlow
  Artifacts for our ASPLOS'23 paper ElasticFlow
  ☆52Updated last year
• msr-fiddle / blox
  ☆44Updated 11 months ago
• James-QiuHaoran / LLM-serving-with-proxy-models
  Efficient Interactive LLM Serving with Proxy Model-based Sequence Length Prediction | A tiny BERT model can tell you the verbosity of an …
  ☆35Updated last year
• SymbioticLab / Oobleck
  A resilient distributed training framework
  ☆95Updated last year
• kungfu-team / tenplex
  Dynamic resources changes for multi-dimensional parallelism training
  ☆25Updated 7 months ago
• hku-systems / naspipe
  ☆14Updated 3 years ago
• Hsword / SpotServe
  SpotServe: Serving Generative Large Language Models on Preemptible Instances
  ☆123Updated last year
• promoe-opensource / promoe
  ☆10Updated 4 months ago
• msr-fiddle / CheckFreq
  ☆53Updated 4 years ago
• suquark / hoplite
  ☆44Updated 3 years ago
• michaelzhiluo / starburst
  Burstable Cloud Scheduler
  ☆13Updated last year
• mutinifni / splitwise-sim
  LLM serving cluster simulator
  ☆106Updated last year
• zhuangwang93 / Cupcake
  Cupcake: A Compression Scheduler for Scalable Communication-Efficient Distributed Training (MLSys '23)
  ☆9Updated last year
• gudiandian / ElasticFlow
  ☆16Updated last year
• S-Lab-System-Group / Awesome-ML-for-System
  SOTA Learning-augmented Systems
  ☆36Updated 3 years ago
• JF-D / Proteus
  ☆23Updated 11 months ago
• suquark / ExoFlow
  A universal workflow system for exactly-once DAGs
  ☆23Updated 2 years ago
• zhuangwang93 / Espresso
  Hi-Speed DNN Training with Espresso: Unleashing the Full Potential of Gradient Compression with Near-Optimal Usage Strategies (EuroSys '2…
  ☆15Updated last year
• liu445126256 / FuncPipe
  ☆11Updated last year
• Thesys-lab / Helix-ASPLOS25
  Open-source implementation for "Helix: Serving Large Language Models over Heterogeneous GPUs and Network via Max-Flow"
  ☆49Updated 7 months ago
• jasperzhong / swift
  ☆14Updated 3 years ago
• icanforce / Orion-OSDI22
  Serverless optimizations
  ☆51Updated last year
• tyler-griggs / melange-release
  ☆47Updated last year
• llm-db / FineInfer
  Deferred Continuous Batching in Resource-Efficient Large Language Model Serving (EuroMLSys 2024)
  ☆16Updated last year