Alternatives and similar repositories for iac-eval

Users that are interested in iac-eval are comparing it to the libraries listed below

• 824728350 / Zodiac
  Zodiac: Unearthing Semantic Checks for Cloud Infrastructure-as-Code Programs, SOSP 2024
  ☆14Updated 11 months ago
• xlab-uiuc / AIOpsLab
  A holistic framework to enable the design, development, and evaluation of autonomous AIOps agents.
  ☆12Updated 5 months ago
• alibaba / CloudEval-YAML
  ☁️ Benchmarking LLMs for Cloud Config Generation ｜ 云场景下的大模型基准测试
  ☆37Updated last year
• JhengLu / OpenInfra
  Simulator for the datacenter, including power, cooling, server and other components
  ☆16Updated 8 months ago
• r2e-project / r2e
  [ICML '24] R2E: Turn any GitHub Repository into a Programming Agent Environment
  ☆133Updated 6 months ago
• evo-eval / evoeval
  EvoEval: Evolving Coding Benchmarks via LLM
  ☆79Updated last year
• yinfangchen / cloud-incident-lit
  Cloud incidents/failures related work.
  ☆19Updated 9 months ago
• microsoft / ACV
  A series of work towards achieving ACV.
  ☆21Updated last month
• itbench-hub / ITBench-Scenarios
  Code repository for scenarios and environment setup as part of ITBench
  ☆12Updated this week
• IBM / LLM-performance-prediction
  Predict the performance of LLM inference services
  ☆20Updated last month
• OrderLab / TrainCheck
  A Framework for Automated Validation of Deep Learning Training Tasks
  ☆52Updated last month
• ulab-uiuc / CS598-Topics-in-LLM-Agents
  Course information for CS598-Topics in LLM Agents(25'Spring) under the direction of Prof. Jiaxuan You ( jiaxuan@illinois.edu ).
  ☆40Updated 6 months ago
• ServerlessLLM / ServerlessLLM
  Serverless LLM Serving for Everyone.
  ☆573Updated last week
• FloridSleeves / LLMDebugger
  LDB: A Large Language Model Debugger via Verifying Runtime Execution Step by Step (ACL'24)
  ☆561Updated last year
• juyongjiang / CodeLLMSurvey
  [TOSEM'25] The official GitHub page for the survey paper "A Survey on Large Language Models for Code Generation".
  ☆167Updated 3 months ago
• thunlp / DebugBench
  The repository for paper "DebugBench: "Evaluating Debugging Capability of Large Language Models".
  ☆83Updated last year
• aladinggit / RDMI
  This is the repo for remote direct memory introspection.
  ☆22Updated 2 years ago
• ml-energy / leaderboard
  How much energy do GenAI models consume?
  ☆47Updated 2 weeks ago
• xlab-uiuc / acto
  Push-Button End-to-End Testing of Kubernetes Operators and Controllers
  ☆128Updated 2 months ago
• zhengzangw / Sequence-Scheduling
  PyTorch implementation of paper "Response Length Perception and Sequence Scheduling: An LLM-Empowered LLM Inference Pipeline".
  ☆92Updated 2 years ago
• YerbaPage / Awesome-Repo-Level-Code-Generation
  Must-read papers on Repository-level Code Generation & Issue Resolution 🔥
  ☆195Updated last week
• dywsjtu / apparate
  Artifact for "Apparate: Rethinking Early Exits to Tame Latency-Throughput Tensions in ML Serving" [SOSP '24]
  ☆25Updated 11 months ago
• SWE-bench / experiments
  Open sourced predictions, execution logs, trajectories, and results from model inference + evaluation runs on the SWE-bench task.
  ☆218Updated last week
• michaelzhiluo / starburst
  Burstable Cloud Scheduler
  ☆15Updated last year
• fanlai0990 / CS598
  Systems for GenAI
  ☆145Updated 6 months ago
• cornserve-ai / cornserve
  Easy, Fast, and Scalable Multimodal AI
  ☆20Updated last week
• ise-uiuc / xft
  XFT: Unlocking the Power of Code Instruction Tuning by Simply Merging Upcycled Mixture-of-Experts
  ☆35Updated last year
• uiuc-kang-lab / leap
  [VLDB'2025] LEAP: LLM-powered End-to-end Automatic Library for Processing Social Science Queries on Unstructured Data
  ☆19Updated 8 months ago
• hao-ai-lab / Dynasor
  [NeurIPS 2025] Simple extension on vLLM to help you speed up reasoning model without training.
  ☆198Updated 5 months ago
• microsoft / CodePlan
  Data and evaluation scripts for "CodePlan: Repository-level Coding using LLMs and Planning", FSE 2024
  ☆75Updated last year