Alternatives and similar repositories for ITBench-Scenarios

Users that are interested in ITBench-Scenarios are comparing it to the libraries listed below

• xlab-uiuc / AIOpsLab
  A holistic framework to enable the design, development, and evaluation of autonomous AIOps agents.
  ☆12Updated 7 months ago
• CUHK-Shenzhen-SE / RetromorphicTesting
  ☆11Updated last year
• thunlp / DebugBench
  The repository for paper "DebugBench: "Evaluating Debugging Capability of Large Language Models".
  ☆85Updated last year
• CUHK-Shenzhen-SE / D4C
  [ICSE'25] Aligning the Objective of LLM-based Program Repair
  ☆23Updated 10 months ago
• xyliu-cs / RISE
  [NeurIPS'25] Official Implementation of RISE (Reinforcing Reasoning with Self-Verification)
  ☆31Updated 5 months ago
• microsoft / OpenRCA
  [ICLR'25] OpenRCA: Can Large Language Models Locate the Root Cause of Software Failures?
  ☆242Updated last week
• k4black / codebleu
  Pip compatible CodeBLEU metric implementation available for linux/macos/win
  ☆128Updated 9 months ago
• logpai / LILAC
  LILAC: Log Parsing using LLMs with Adaptive Parsing Cache [FSE'24]
  ☆64Updated last year
• ozyyshr / RepoGraph
  Enhancing AI Software Engineering with Repository-level Code Graph
  ☆246Updated 9 months ago
• oceaneLIU / GraphCoder
  ☆57Updated last year
• LGU-SE-Internal / GRev
  A lightweight tool for detecting bugs on Graph Database Management Systems
  ☆15Updated 2 years ago
• afortunado-aceptado / Rudra
  This repo is for our submission for ICSE 2025.
  ☆20Updated last year
• logpai / hybridlogparser
  A toolkit for hybrid log parsing
  ☆18Updated 2 years ago
• theoxo / self-repair
  [ICLR 2024]: Is Self-Repair a Silver Bullet for Code Generation?
  ☆15Updated last year
• FudanSELab / ClassEval
  Benchmark ClassEval for class-level code generation.
  ☆145Updated last year
• sola-st / RepairAgent
  RepairAgent is an autonomous LLM-based agent for software repair.
  ☆81Updated 5 months ago
• floatai / HumanEval-XL
  [LREC-COLING'24] HumanEval-XL: A Multilingual Code Generation Benchmark for Cross-lingual Natural Language Generalization
  ☆40Updated 10 months ago
• JohnnyPeng18 / Coffe
  A Code Efficiency Benchmark for Code Generation
  ☆13Updated 7 months ago
• gai4se / LLM4SE
  Large Language Models for Software Engineering
  ☆259Updated 5 months ago
• llylly / RANUM
  [ICSE 2023] Differentiable interpretation and failure-inducing input generation for neural network numerical bugs.
  ☆13Updated 2 years ago
• CoderEval / CoderEval
  A collection of practical code generation tasks and tests in open source projects. Complementary to HumanEval by OpenAI.
  ☆154Updated last year
• logpai / AutoLog
  AutoLog: A Log Sequence Synthesis Framework for Anomaly Detection [ASE'23]
  ☆41Updated last year
• uiuc-kang-lab / leap
  [VLDB'2025] LEAP: LLM-powered End-to-end Automatic Library for Processing Social Science Queries on Unstructured Data
  ☆19Updated 2 months ago
• evo-eval / evoeval
  EvoEval: Evolving Coding Benchmarks via LLM
  ☆80Updated last year
• seketeam / EvoCodeBench
  An Evolving Code Generation Benchmark Aligned with Real-world Code Repositories
  ☆67Updated last year
• multi-swe-bench / multi-swe-bench
  Multi-SWE-bench: A Multilingual Benchmark for Issue Resolving
  ☆308Updated last month
• yinfangchen / cloud-incident-lit
  Cloud incidents/failures related work.
  ☆20Updated last year
• LLM4SoftwareTesting / TestEval
  ☆33Updated 11 months ago
• r2e-project / r2e
  [ICML '24] R2E: Turn any GitHub Repository into a Programming Agent Environment
  ☆138Updated 9 months ago
• CUHK-ARISE / MAS-Resilience
  Code and data for the paper: On the Resilience of LLM-Based Multi-Agent Collaboration with Faulty Agents
  ☆41Updated last month