Alternatives and similar repositories for CloudEval-YAML

Users that are interested in CloudEval-YAML are comparing it to the libraries listed below

• cirquit / hivemind-multi-cloud
  ☆9Updated last year
• dywsjtu / apparate
  Artifact for "Apparate: Rethinking Early Exits to Tame Latency-Throughput Tensions in ML Serving" [SOSP '24]
  ☆25Updated 8 months ago
• project-etalon / etalon
  LLM Serving Performance Evaluation Harness
  ☆79Updated 5 months ago
• Hsword / SpotServe
  SpotServe: Serving Generative Large Language Models on Preemptible Instances
  ☆126Updated last year
• IBM / LLM-performance-prediction
  Predict the performance of LLM inference services
  ☆19Updated 3 months ago
• James-QiuHaoran / LLM-serving-with-proxy-models
  Efficient Interactive LLM Serving with Proxy Model-based Sequence Length Prediction | A tiny BERT model can tell you the verbosity of an …
  ☆39Updated last year
• S-Lab-System-Group / Hydro
  Surrogate-based Hyperparameter Tuning System
  ☆28Updated 2 years ago
• S-Lab-System-Group / Primo
  Primo: Practical Learning-Augmented Systems with Interpretable Models
  ☆19Updated last year
• IntelligentDDS / LogReducer
  ☆14Updated 2 years ago
• UChi-JCL / CacheGen
  ☆116Updated 10 months ago
• hao-ai-lab / vllm-ltr
  [NeurIPS 2024] Efficient LLM Scheduling by Learning to Rank
  ☆55Updated 9 months ago
• huaweicloud / trace_generation_rnn
  This repository contains code for the paper: Bergsma S., Zeyl T., Senderovich A., and Beck J. C., "Generating Complex, Realistic Cloud Wo…
  ☆43Updated 3 years ago
• AmyWorkspace / nassim
  Data repository of NAssim
  ☆25Updated 2 years ago
• suquark / hoplite
  ☆44Updated 3 years ago
• S-Lab-System-Group / ChronusArtifact
  ☆22Updated 3 years ago
• tyler-griggs / melange-release
  ☆47Updated last year
• SymbioticLab / ModelKeeper
  A Cluster-Wide Model Manager to Accelerate DNN Training via Automated Training Warmup
  ☆35Updated 2 years ago
• SymbioticLab / Oobleck
  A resilient distributed training framework
  ☆94Updated last year
• WukLab / preble
  Stateful LLM Serving
  ☆79Updated 5 months ago
• microsoft / ParrotServe
  [OSDI'24] Serving LLM-based Applications Efficiently with Semantic Variable
  ☆172Updated 10 months ago
• stanford-mast / INFaaS
  Model-less Inference Serving
  ☆90Updated last year
• NetX-lab / Ayo
  [ASPLOS'25] Towards End-to-End Optimization of LLM-based Applications with Ayo
  ☆32Updated this week
• msr-fiddle / blox
  ☆44Updated last year
• S-Lab-System-Group / Awesome-ML-for-System
  SOTA Learning-augmented Systems
  ☆36Updated 3 years ago
• Rivendile / Muri
  Artifacts for our SIGCOMM'22 paper Muri
  ☆41Updated last year
• WukLab / InferCept
  ☆28Updated last year
• zhengzangw / Sequence-Scheduling
  PyTorch implementation of paper "Response Length Perception and Sequence Scheduling: An LLM-Empowered LLM Inference Pipeline".
  ☆90Updated 2 years ago
• stanford-futuredata / POP
  Code for "Solving Large-Scale Granular Resource Allocation Problems Efficiently with POP", which appeared at SOSP 2021
  ☆26Updated 3 years ago
• pengyanghua / optimus
  A Deep Learning Cluster Scheduler
  ☆39Updated 4 years ago
• llm-db / FineInfer
  Deferred Continuous Batching in Resource-Efficient Large Language Model Serving (EuroMLSys 2024)
  ☆16Updated last year