alibaba / CloudEval-YAMLLinks
☁️ Benchmarking LLMs for Cloud Config Generation | 云场景下的大模型基准测试
☆37Updated 11 months ago
Alternatives and similar repositories for CloudEval-YAML
Users that are interested in CloudEval-YAML are comparing it to the libraries listed below
Sorting:
- Surrogate-based Hyperparameter Tuning System☆27Updated 2 years ago
- SpotServe: Serving Generative Large Language Models on Preemptible Instances☆129Updated last year
- Artifact for "Apparate: Rethinking Early Exits to Tame Latency-Throughput Tensions in ML Serving" [SOSP '24]☆25Updated 10 months ago
- Efficient Interactive LLM Serving with Proxy Model-based Sequence Length Prediction | A tiny BERT model can tell you the verbosity of an …☆44Updated last year
- ☆44Updated last year
- This repository contains code for the paper: Bergsma S., Zeyl T., Senderovich A., and Beck J. C., "Generating Complex, Realistic Cloud Wo…☆43Updated 3 years ago
- ☆44Updated 4 years ago
- ☆23Updated 3 years ago
- Artifacts for our SIGCOMM'22 paper Muri☆43Updated last year
- Primo: Practical Learning-Augmented Systems with Interpretable Models☆19Updated last year
- Dynamic resources changes for multi-dimensional parallelism training☆28Updated last month
- [ASPLOS'25] Towards End-to-End Optimization of LLM-based Applications with Ayo☆43Updated 2 months ago
- Model-less Inference Serving☆92Updated last year
- Stateful LLM Serving☆85Updated 6 months ago
- LLM Serving Performance Evaluation Harness☆79Updated 7 months ago
- Predict the performance of LLM inference services☆20Updated 2 weeks ago
- Tiresias is a GPU cluster manager for distributed deep learning training.☆160Updated 5 years ago
- The source code of INFless,a native serverless platform for AI inference.☆40Updated 2 years ago
- Artifact for "Shockwave: Fair and Efficient Cluster Scheduling for Dynamic Adaptation in Machine Learning" [NSDI '23]☆45Updated 2 years ago
- A benchmark suite for evaluating FaaS scheduler.☆23Updated 2 years ago
- ☆55Updated 3 weeks ago
- PipeSwitch: Fast Pipelined Context Switching for Deep Learning Applications☆127Updated 3 years ago
- SOTA Learning-augmented Systems☆37Updated 3 years ago
- A Deep Learning Cluster Scheduler☆39Updated 4 years ago
- HeliosArtifact☆21Updated 3 years ago
- Artifact of OSDI '24 paper, ”Llumnix: Dynamic Scheduling for Large Language Model Serving“☆62Updated last year
- ☆162Updated last year
- MeshInsight: Dissecting Overheads of Service Mesh Sidecars☆47Updated last year
- A Cluster-Wide Model Manager to Accelerate DNN Training via Automated Training Warmup☆35Updated 2 years ago
- Deferred Continuous Batching in Resource-Efficient Large Language Model Serving (EuroMLSys 2024)☆18Updated last year