Alternatives and similar repositories for iac-eval

Users that are interested in iac-eval are comparing it to the libraries listed below

• 824728350 / Zodiac
  Zodiac: Unearthing Semantic Checks for Cloud Infrastructure-as-Code Programs, SOSP 2024
  ☆13Updated 8 months ago
• xlab-uiuc / AIOpsLab
  A holistic framework to enable the design, development, and evaluation of autonomous AIOps agents.
  ☆12Updated 2 months ago
• JhengLu / OpenInfra
  Simulator for the datacenter, including power, cooling, server and other components
  ☆16Updated 6 months ago
• alibaba / CloudEval-YAML
  ☁️ Benchmarking LLMs for Cloud Config Generation ｜ 云场景下的大模型基准测试
  ☆33Updated 9 months ago
• aladinggit / RDMI
  This is the repo for remote direct memory introspection.
  ☆22Updated 2 years ago
• OrderLab / TrainCheck
  A Framework for Automated Validation of Deep Learning Training Tasks
  ☆46Updated last week
• ServerlessLLM / ServerlessLLM
  Serverless LLM Serving for Everyone.
  ☆516Updated this week
• ml-energy / leaderboard
  How much energy do GenAI models consume?
  ☆46Updated 2 months ago
• r2e-project / r2e
  r2e: turn any github repository into a programming agent environment
  ☆129Updated 3 months ago
• dywsjtu / apparate
  Artifact for "Apparate: Rethinking Early Exits to Tame Latency-Throughput Tensions in ML Serving" [SOSP '24]
  ☆25Updated 8 months ago
• IBM / LLM-performance-prediction
  Predict the performance of LLM inference services
  ☆19Updated 3 months ago
• cornserve-ai / cornserve
  Easy, Fast, and Scalable Multimodal AI
  ☆17Updated this week
• tyler-griggs / melange-release
  ☆47Updated last year
• project-etalon / etalon
  LLM Serving Performance Evaluation Harness
  ☆79Updated 5 months ago
• yinfangchen / cloud-incident-lit
  Cloud incidents/failures related work.
  ☆19Updated 7 months ago
• zhengzangw / Sequence-Scheduling
  PyTorch implementation of paper "Response Length Perception and Sequence Scheduling: An LLM-Empowered LLM Inference Pipeline".
  ☆90Updated 2 years ago
• ulab-uiuc / CS598-Topics-in-LLM-Agents
  Course information for CS598-Topics in LLM Agents(25'Spring) under the direction of Prof. Jiaxuan You ( jiaxuan@illinois.edu ).
  ☆32Updated 3 months ago
• NetX-lab / Ayo
  [ASPLOS'25] Towards End-to-End Optimization of LLM-based Applications with Ayo
  ☆32Updated this week
• SotaroKaneda / MLCarbon
  End-to-end carbon footprint mod- eling tool
  ☆45Updated 2 months ago
• UChi-JCL / CacheGen
  ☆116Updated 10 months ago
• cirquit / hivemind-multi-cloud
  ☆9Updated last year
• uiuc-kang-lab / leap
  LEAP is an end-to-end library designed to support social science research by automatically analyzing user-collected unstructured data in …
  ☆17Updated 6 months ago
• hao-ai-lab / Dynasor
  Simple extension on vLLM to help you speed up reasoning model without training.
  ☆174Updated 2 months ago
• FudanSELab / serverless-trainticket
  ☆62Updated 2 years ago
• James-QiuHaoran / LLM-serving-with-proxy-models
  Efficient Interactive LLM Serving with Proxy Model-based Sequence Length Prediction | A tiny BERT model can tell you the verbosity of an …
  ☆39Updated last year
• VTool-R1 / VTool-R1
  Code for the paper "VTool-R1: VLMs Learn to Think with Images via Reinforcement Learning on Multimodal Tool Use"
  ☆105Updated last week
• yale-sys / prompt-cache
  Modular and structured prompt caching for low-latency LLM inference
  ☆98Updated 9 months ago
• HPMLL / BurstGPT
  A ChatGPT(GPT-3.5) & GPT-4 Workload Trace to Optimize LLM Serving Systems
  ☆191Updated 2 weeks ago
• microsoft / ParrotServe
  [OSDI'24] Serving LLM-based Applications Efficiently with Semantic Variable
  ☆172Updated 10 months ago
• microsoft / ACV
  A series of work towards achieving ACV.
  ☆20Updated last week