Alternatives and similar repositories for iac-eval

Users that are interested in iac-eval are comparing it to the libraries listed below

• 824728350 / Zodiac
  Zodiac: Unearthing Semantic Checks for Cloud Infrastructure-as-Code Programs, SOSP 2024
  ☆15Updated last year
• xlab-uiuc / AIOpsLab
  A holistic framework to enable the design, development, and evaluation of autonomous AIOps agents.
  ☆12Updated 7 months ago
• ServerlessLLM / ServerlessLLM
  Serverless LLM Serving for Everyone.
  ☆634Updated this week
• RouteWorks / RouterArena
  RouterArena: An open framework for evaluating LLM routers with standardized datasets, metrics, an automated framework, and a live leaderb…
  ☆59Updated this week
• OrderLab / TrainCheck
  A Framework for Automated Validation of Deep Learning Training Tasks
  ☆60Updated last week
• UCB-ADRS / ADRS
  AI-Driven Research Systems (ADRS)
  ☆117Updated last month
• fanlai0990 / CS598
  Systems for GenAI
  ☆153Updated this week
• microsoft / ParrotServe
  [OSDI'24] Serving LLM-based Applications Efficiently with Semantic Variable
  ☆207Updated last year
• UChi-JCL / CacheGen
  ☆147Updated last year
• ml-energy / leaderboard-v2
  A canonical source of GenAI energy benchmark and meausrements
  ☆50Updated last month
• tyler-griggs / melange-release
  ☆48Updated last year
• hao-ai-lab / vllm-ltr
  [NeurIPS 2024] Efficient LLM Scheduling by Learning to Rank
  ☆67Updated last year
• NetX-lab / Ayo
  [ASPLOS'25] Towards End-to-End Optimization of LLM-based Applications with Ayo
  ☆59Updated 5 months ago
• IBM / LLM-performance-prediction
  Predict the performance of LLM inference services
  ☆21Updated 4 months ago
• zhengzangw / Sequence-Scheduling
  PyTorch implementation of paper "Response Length Perception and Sequence Scheduling: An LLM-Empowered LLM Inference Pipeline".
  ☆93Updated 2 years ago
• microsoft / vidur
  A large-scale simulation framework for LLM inference
  ☆522Updated 5 months ago
• ulab-uiuc / CS598-Topics-in-LLM-Agents
  Course information for CS598-Topics in LLM Agents(25'Spring) under the direction of Prof. Jiaxuan You ( jiaxuan@illinois.edu ).
  ☆48Updated 8 months ago
• eth-easl / sailor
  AI model training on heterogeneous, geo-distributed resources
  ☆33Updated last month
• SREGym / SREGym
  An AI-Native Platform for Benchmarking SRE Agents
  ☆63Updated this week
• Hanchenli / vllm-continuum
  Preview Code for Continuum Paper
  ☆25Updated 2 weeks ago
• SotaroKaneda / MLCarbon
  End-to-end carbon footprint mod- eling tool
  ☆52Updated 7 months ago
• Infini-AI-Lab / MagicPIG
  [ICLR2025 Spotlight] MagicPIG: LSH Sampling for Efficient LLM Generation
  ☆245Updated last year
• SymbioticLab / Oobleck
  A resilient distributed training framework
  ☆96Updated last year
• Mercidaiha / IRT-Router
  [ACL'25] Code for ACL'25 paper "IRT-Router: Effective and Interpretable Multi-LLM Routing via Item Response Theory"
  ☆25Updated 11 months ago
• hao-ai-lab / Dynasor
  [NeurIPS 2025] Simple extension on vLLM to help you speed up reasoning model without training.
  ☆217Updated 7 months ago
• project-etalon / etalon
  LLM Serving Performance Evaluation Harness
  ☆82Updated 10 months ago
• yinfangchen / cloud-incident-lit
  Cloud incidents/failures related work.
  ☆20Updated last year
• Hsword / SpotServe
  SpotServe: Serving Generative Large Language Models on Preemptible Instances
  ☆134Updated last year
• dywsjtu / apparate
  Artifact for "Apparate: Rethinking Early Exits to Tame Latency-Throughput Tensions in ML Serving" [SOSP '24]
  ☆25Updated last year
• Ying1123 / VTC-artifact
  ☆43Updated last year