Alternatives and similar repositories for iac-eval

Users that are interested in iac-eval are comparing it to the libraries listed below

• 824728350 / Zodiac
  Zodiac: Unearthing Semantic Checks for Cloud Infrastructure-as-Code Programs, SOSP 2024
  ☆14Updated last year
• xlab-uiuc / AIOpsLab
  A holistic framework to enable the design, development, and evaluation of autonomous AIOps agents.
  ☆12Updated 6 months ago
• r2e-project / r2e
  [ICML '24] R2E: Turn any GitHub Repository into a Programming Agent Environment
  ☆135Updated 7 months ago
• ServerlessLLM / ServerlessLLM
  Serverless LLM Serving for Everyone.
  ☆611Updated this week
• OrderLab / TrainCheck
  A Framework for Automated Validation of Deep Learning Training Tasks
  ☆53Updated 2 months ago
• ulab-uiuc / CS598-Topics-in-LLM-Agents
  Course information for CS598-Topics in LLM Agents(25'Spring) under the direction of Prof. Jiaxuan You ( jiaxuan@illinois.edu ).
  ☆41Updated 7 months ago
• FSoft-AI4Code / RepoExec
  [NAACL 2025] Benchmark for Repository-Level Code Generation, focus on Executability, Correctness from Test Cases and Usage of Contexts fr…
  ☆36Updated 8 months ago
• alibaba / CloudEval-YAML
  ☁️ Benchmarking LLMs for Cloud Config Generation ｜ 云场景下的大模型基准测试
  ☆37Updated last year
• JhengLu / OpenInfra
  Simulator for the datacenter, including power, cooling, server and other components
  ☆16Updated 9 months ago
• UbiquitousLearning / Paper-list-resource-efficient-large-language-model
  ☆101Updated last year
• multi-agent-systems-failure-taxonomy / MAST
  ☆297Updated 4 months ago
• RouteWorks / RouterArena
  RouterArena: An open framework for evaluating LLM routers with standardized datasets, metrics, an automated framework, and a live leaderb…
  ☆39Updated last week
• guanyilin428 / Dynamic-Speculative-Planning
  ☆31Updated 2 months ago
• IBM / LLM-performance-prediction
  Predict the performance of LLM inference services
  ☆20Updated 2 months ago
• hao-ai-lab / Dynasor
  [NeurIPS 2025] Simple extension on vLLM to help you speed up reasoning model without training.
  ☆207Updated 6 months ago
• zhengzangw / Sequence-Scheduling
  PyTorch implementation of paper "Response Length Perception and Sequence Scheduling: An LLM-Empowered LLM Inference Pipeline".
  ☆94Updated 2 years ago
• Infini-AI-Lab / APE
  ☆34Updated 9 months ago
• duowuyms / OpenCATP-LLM
  The official repository of ICCV 2025 paper "CATP-LLM: Empowering Large Language Models for Cost-Aware Tool Planning".
  ☆16Updated 3 weeks ago
• Ketonmi / Awesome-Large-Scale-LLM-Serving
  Must-read papers on improving efficiency for LLM serving clusters
  ☆31Updated 6 months ago
• MASWorks / MASLab
  ☆197Updated 4 months ago
• ganler / code-r1
  Reproducing R1 for Code with Reliable Rewards
  ☆272Updated 6 months ago
• itbench-hub / ITBench-Scenarios
  Code repository for scenarios and environment setup as part of ITBench
  ☆13Updated this week
• open-compass / DevEval
  A Comprehensive Benchmark for Software Development.
  ☆119Updated last year
• yale-sys / prompt-cache
  Modular and structured prompt caching for low-latency LLM inference
  ☆103Updated last year
• R2E-Gym / R2E-Gym
  [COLM 2025] Official repository for R2E-Gym: Procedural Environment Generation and Hybrid Verifiers for Scaling Open-Weights SWE Agents
  ☆197Updated 4 months ago
• microsoft / ParrotServe
  [OSDI'24] Serving LLM-based Applications Efficiently with Semantic Variable
  ☆196Updated last year
• Infini-AI-Lab / MagicPIG
  [ICLR2025 Spotlight] MagicPIG: LSH Sampling for Efficient LLM Generation
  ☆241Updated 11 months ago
• multi-swe-bench / multi-swe-bench
  Multi-SWE-bench: A Multilingual Benchmark for Issue Resolving
  ☆282Updated 2 weeks ago
• hao-ai-lab / vllm-ltr
  [NeurIPS 2024] Efficient LLM Scheduling by Learning to Rank
  ☆64Updated last year
• thunlp / DebugBench
  The repository for paper "DebugBench: "Evaluating Debugging Capability of Large Language Models".
  ☆84Updated last year