Alternatives and similar repositories for ITBench-Scenarios

Users that are interested in ITBench-Scenarios are comparing it to the libraries listed below

• xlab-uiuc / AIOpsLab
  A holistic framework to enable the design, development, and evaluation of autonomous AIOps agents.
  ☆12Updated 6 months ago
• thunlp / DebugBench
  The repository for paper "DebugBench: "Evaluating Debugging Capability of Large Language Models".
  ☆84Updated last year
• logpai / LILAC
  LILAC: Log Parsing using LLMs with Adaptive Parsing Cache [FSE'24]
  ☆60Updated last year
• CUHK-Shenzhen-SE / RetromorphicTesting
  ☆11Updated 10 months ago
• CUHK-Shenzhen-SE / D4C
  [ICSE'25] Aligning the Objective of LLM-based Program Repair
  ☆22Updated 8 months ago
• microsoft / OpenRCA
  [ICLR'25] OpenRCA: Can Large Language Models Locate the Root Cause of Software Failures?
  ☆216Updated 2 weeks ago
• afortunado-aceptado / Rudra
  This repo is for our submission for ICSE 2025.
  ☆20Updated last year
• k4black / codebleu
  Pip compatible CodeBLEU metric implementation available for linux/macos/win
  ☆125Updated 8 months ago
• logic-star-ai / swt-bench
  [NeurIPS 2024] Evaluation harness for SWT-Bench, a benchmark for evaluating LLM repository-level test-generation
  ☆62Updated 2 months ago
• DeepSoftwareAnalytics / RLCoder
  Reinforcement Learning for Repository-Level Code Completion
  ☆42Updated last year
• FudanSELab / ClassEval
  Benchmark ClassEval for class-level code generation.
  ☆145Updated last year
• logpai / AutoLog
  AutoLog: A Log Sequence Synthesis Framework for Anomaly Detection [ASE'23]
  ☆40Updated last year
• xyliu-cs / RISE
  [NeurIPS'25] Official Implementation of RISE (Reinforcing Reasoning with Self-Verification)
  ☆30Updated 3 months ago
• yinfangchen / cloud-incident-lit
  Cloud incidents/failures related work.
  ☆19Updated 10 months ago
• dlfaults / deepcrime
  DeepCrime - Mutation Testing Tool for Deep Learning Systems
  ☆15Updated 2 years ago
• evo-eval / evoeval
  EvoEval: Evolving Coding Benchmarks via LLM
  ☆80Updated last year
• llylly / RANUM
  [ICSE 2023] Differentiable interpretation and failure-inducing input generation for neural network numerical bugs.
  ☆13Updated last year
• ozyyshr / RepoGraph
  Enhancing AI Software Engineering with Repository-level Code Graph
  ☆228Updated 7 months ago
• seketeam / EvoCodeBench
  An Evolving Code Generation Benchmark Aligned with Real-world Code Repositories
  ☆66Updated last year
• gai4se / LLM4SE
  Large Language Models for Software Engineering
  ☆255Updated 4 months ago
• logpai / hybridlogparser
  A toolkit for hybrid log parsing
  ☆18Updated 2 years ago
• nju-websoft / DraCo
  Dataflow-guided retrieval augmentation for repository-level code completion, ACL 2024 (main)
  ☆29Updated 8 months ago
• amazon-science / Repoformer
  Repoformer: Selective Retrieval for Repository-Level Code Completion (ICML 2024)
  ☆61Updated 5 months ago
• CoderEval / CoderEval
  A collection of practical code generation tasks and tests in open source projects. Complementary to HumanEval by OpenAI.
  ☆155Updated 11 months ago
• logpai / loghub-2.0
  A Large-scale Evaluation for Log Parsing Techniques: How Far are We? [ISSTA'24]
  ☆126Updated last month
• JohnnyPeng18 / Coffe
  A Code Efficiency Benchmark for Code Generation
  ☆11Updated 6 months ago
• shanshw / LogConfigLocalizer
  ☆15Updated 7 months ago
• amazon-science / cocomic
  CoCoMIC: Code Completion By Jointly Modeling In-file and Cross-file Context
  ☆18Updated 3 months ago
• IBM / TDD-Bench-Verified
  TDD-Bench-Verified is a new benchmark for generating test cases for test-driven development (TDD)
  ☆25Updated 2 months ago
• LogIntelligence / log-analytics-chatgpt
  Log Parsing: How Far Can ChatGPT Go? (ASE 2023 - NIER Track)
  ☆21Updated last year