Alternatives and similar repositories for CloudEval-YAML

Users that are interested in CloudEval-YAML are comparing it to the libraries listed below

• dywsjtu / apparate
  Artifact for "Apparate: Rethinking Early Exits to Tame Latency-Throughput Tensions in ML Serving" [SOSP '24]
  ☆25Updated 11 months ago
• IBM / LLM-performance-prediction
  Predict the performance of LLM inference services
  ☆20Updated last month
• S-Lab-System-Group / ChronusArtifact
  ☆23Updated 3 years ago
• S-Lab-System-Group / Primo
  Primo: Practical Learning-Augmented Systems with Interpretable Models
  ☆19Updated last year
• S-Lab-System-Group / Hydro
  Surrogate-based Hyperparameter Tuning System
  ☆27Updated 2 years ago
• Hsword / SpotServe
  SpotServe: Serving Generative Large Language Models on Preemptible Instances
  ☆130Updated last year
• huaweicloud / trace_generation_rnn
  This repository contains code for the paper: Bergsma S., Zeyl T., Senderovich A., and Beck J. C., "Generating Complex, Realistic Cloud Wo…
  ☆43Updated 3 years ago
• project-etalon / etalon
  LLM Serving Performance Evaluation Harness
  ☆79Updated 8 months ago
• IntelligentDDS / LogReducer
  ☆15Updated 2 years ago
• stanford-mast / INFaaS
  Model-less Inference Serving
  ☆92Updated last year
• suquark / hoplite
  ☆44Updated 4 years ago
• msr-fiddle / blox
  ☆43Updated last year
• stanford-futuredata / POP
  Code for "Solving Large-Scale Granular Resource Allocation Problems Efficiently with POP", which appeared at SOSP 2021
  ☆27Updated 3 years ago
• S-Lab-System-Group / HeliosArtifact
  HeliosArtifact
  ☆21Updated 3 years ago
• llm-db / FineInfer
  Deferred Continuous Batching in Resource-Efficient Large Language Model Serving (EuroMLSys 2024)
  ☆19Updated last year
• All-less / faas-scheduling-benchmark
  A benchmark suite for evaluating FaaS scheduler.
  ☆23Updated 2 years ago
• SymbioticLab / ModelKeeper
  A Cluster-Wide Model Manager to Accelerate DNN Training via Automated Training Warmup
  ☆35Updated 2 years ago
• UChi-JCL / CacheGen
  ☆136Updated last year
• WukLab / InferCept
  ☆30Updated last year
• reconfigurable-ml-pipeline / ipa
  Source code of IPA, https://escholarship.org/uc/item/2p0805dq
  ☆11Updated last year
• kvcache-ai / TrEnv-X
  ☆63Updated last month
• James-QiuHaoran / LLM-serving-with-proxy-models
  Efficient Interactive LLM Serving with Proxy Model-based Sequence Length Prediction | A tiny BERT model can tell you the verbosity of an …
  ☆47Updated last year
• jasperzhong / swift
  ☆15Updated 3 years ago
• uw-mad-dash / shockwave
  Artifact for "Shockwave: Fair and Efficient Cluster Scheduling for Dynamic Adaptation in Machine Learning" [NSDI '23]
  ☆45Updated 2 years ago
• Rivendile / Muri
  Artifacts for our SIGCOMM'22 paper Muri
  ☆43Updated last year
• WukLab / preble
  Stateful LLM Serving
  ☆87Updated 7 months ago
• michaelzhiluo / starburst
  Burstable Cloud Scheduler
  ☆15Updated last year
• TankLabTJU / INFless
  The source code of INFless，a native serverless platform for AI inference.
  ☆41Updated 3 years ago
• S-Lab-System-Group / Awesome-ML-for-System
  SOTA Learning-augmented Systems
  ☆37Updated 3 years ago
• romilbhardwaj / cilantro
  Source code for OSDI 2023 paper titled "Cilantro - Performance-Aware Resource Allocation for General Objectives via Online Feedback"
  ☆40Updated 2 years ago