Alternatives and similar repositories for ITBench-Scenarios

Users that are interested in ITBench-Scenarios are comparing it to the libraries listed below

• xlab-uiuc / AIOpsLab
  A holistic framework to enable the design, development, and evaluation of autonomous AIOps agents.
  ☆12Updated 5 months ago
• thunlp / DebugBench
  The repository for paper "DebugBench: "Evaluating Debugging Capability of Large Language Models".
  ☆83Updated last year
• CUHK-Shenzhen-SE / RetromorphicTesting
  ☆11Updated 9 months ago
• CUHK-Shenzhen-SE / D4C
  [ICSE'25] Aligning the Objective of LLM-based Program Repair
  ☆20Updated 7 months ago
• yinfangchen / cloud-incident-lit
  Cloud incidents/failures related work.
  ☆19Updated 9 months ago
• logpai / LILAC
  LILAC: Log Parsing using LLMs with Adaptive Parsing Cache [FSE'24]
  ☆57Updated last year
• xyliu-cs / RISE
  [NeurIPS'25] Official Implementation of RISE (Reinforcing Reasoning with Self-Verification)
  ☆30Updated 2 months ago
• microsoft / OpenRCA
  [ICLR'25] OpenRCA: Can Large Language Models Locate the Root Cause of Software Failures?
  ☆187Updated last week
• itbench-hub / ITBench-SRE-Agent
  Code repository for SRE agent as part of ITBench
  ☆18Updated last month
• DeepSoftwareAnalytics / RLCoder
  Reinforcement Learning for Repository-Level Code Completion
  ☆40Updated last year
• logpai / AutoLog
  AutoLog: A Log Sequence Synthesis Framework for Anomaly Detection [ASE'23]
  ☆40Updated last year
• r2e-project / r2e
  [ICML '24] R2E: Turn any GitHub Repository into a Programming Agent Environment
  ☆133Updated 6 months ago
• ise-uiuc / xft
  XFT: Unlocking the Power of Code Instruction Tuning by Simply Merging Upcycled Mixture-of-Experts
  ☆35Updated last year
• microsoft / ACV
  A series of work towards achieving ACV.
  ☆21Updated last month
• logpai / hybridlogparser
  A toolkit for hybrid log parsing
  ☆18Updated 2 years ago
• LogIntelligence / log-analytics-chatgpt
  Log Parsing: How Far Can ChatGPT Go? (ASE 2023 - NIER Track)
  ☆21Updated last year
• evo-eval / evoeval
  EvoEval: Evolving Coding Benchmarks via LLM
  ☆79Updated last year
• llylly / RANUM
  [ICSE 2023] Differentiable interpretation and failure-inducing input generation for neural network numerical bugs.
  ☆13Updated last year
• lonyle / ShapleyIQ
  Code and Data to reproduce the ASPLOS'23 paper "ShapleyIQ: Influence Quantification by Shapley Values for Performance Debugging of Micros…
  ☆13Updated last year
• shanshw / LogConfigLocalizer
  ☆14Updated 6 months ago
• mlapistudy / ICSE2021_421
  This is the artifact for paper “Are Machine Learning Cloud APIs Used Correctly? (#421)” in ICSE2021
  ☆16Updated 4 years ago
• gai4se / LLM4SE
  Large Language Models for Software Engineering
  ☆250Updated 3 months ago
• open-compass / DevEval
  A Comprehensive Benchmark for Software Development.
  ☆115Updated last year
• dlfaults / deepcrime
  DeepCrime - Mutation Testing Tool for Deep Learning Systems
  ☆15Updated 2 years ago
• CoderEval / CoderEval
  A collection of practical code generation tasks and tests in open source projects. Complementary to HumanEval by OpenAI.
  ☆152Updated 10 months ago
• afortunado-aceptado / Rudra
  This repo is for our submission for ICSE 2025.
  ☆20Updated last year
• FudanSELab / ClassEval
  Benchmark ClassEval for class-level code generation.
  ☆145Updated last year
• seketeam / DevEval
  A Manually-Annotated Code Generation Benchmark Aligned with Real-World Code Repositories
  ☆33Updated last year
• alibaba / CloudEval-YAML
  ☁️ Benchmarking LLMs for Cloud Config Generation ｜ 云场景下的大模型基准测试
  ☆37Updated last year
• logic-star-ai / swt-bench
  [NeurIPS 2024] Evaluation harness for SWT-Bench, a benchmark for evaluating LLM repository-level test-generation
  ☆58Updated last month