[NeurIPS 2024] Evaluation harness for SWT-Bench, a benchmark for evaluating LLM repository-level test-generation
☆76Apr 28, 2026Updated last week
Alternatives and similar repositories for swt-bench
Users that are interested in swt-bench are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [ICSE'25] Aligning the Objective of LLM-based Program Repair☆23Mar 8, 2025Updated last year
- Agentless Lite: RAG-based SWE-Bench software engineering scaffold☆46Apr 15, 2025Updated last year
- CodeRepoQA dataset☆15Feb 19, 2025Updated last year
- The official repo for the paper Can ChatGPT replace StackOverflow? A Study on Robustness and Reliability of Large Language Model Code Gen…☆20Feb 27, 2024Updated 2 years ago
- ☆134Jun 6, 2025Updated 10 months ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- TDD-Bench-Verified is a new benchmark for generating test cases for test-driven development (TDD)☆29Apr 28, 2026Updated last week
- ☆28Nov 10, 2025Updated 5 months ago
- [TOSEM 2026]A Systematic Literature Review on Large Language Models for Automated Program Repair☆235Updated this week
- [ACL'25] UTBoost: Rigorous Evaluation of Coding Agents on SWE-Bench☆36Aug 12, 2025Updated 8 months ago
- The repository for paper "DebugBench: "Evaluating Debugging Capability of Large Language Models".☆85Jul 13, 2024Updated last year
- Synthesized models for PHOG to make the results reproducible by the research community☆11Jan 23, 2020Updated 6 years ago
- junit tools contest infrastructure☆13Feb 9, 2024Updated 2 years ago
- [NeurIPS 2025 D&B Spotlight] Scaling Data for SWE-agents☆639Apr 27, 2026Updated last week
- Code for "[COLM'25] RepoST: Scalable Repository-Level Coding Environment Construction with Sandbox Testing"☆24Mar 18, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- AutoLog: A Log Sequence Synthesis Framework for Anomaly Detection [ASE'23]☆40Feb 20, 2024Updated 2 years ago
- ☆15Oct 11, 2023Updated 2 years ago
- SRI Group Website☆11Updated this week
- Improving Machine Translation Systems via Isotopic Replacement☆12Apr 14, 2023Updated 3 years ago
- A tool for REST API test coverage computation☆21Nov 12, 2025Updated 5 months ago
- EvoEval: Evolving Coding Benchmarks via LLM☆81Apr 6, 2024Updated 2 years ago
- [NeurIPS'25] The official code of "PeRL: Permutation-Enhanced Reinforcement Learning for Interleaved Vision-Language Reasoning"☆30Mar 30, 2026Updated last month
- ☆14Mar 13, 2021Updated 5 years ago
- [NeurIPS 2025 D&B] 🚀 SWE-bench Goes Live!☆187Apr 25, 2026Updated last week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Knowledge Graph based Question Answering benchmark.☆10Feb 1, 2020Updated 6 years ago
- Data and Code for Paper "Reflect Not Reflex: Inference-Based Common Ground Improves Dialogue Response Quality" (EMNLP 2022)☆11Nov 28, 2022Updated 3 years ago
- ☆12Nov 5, 2024Updated last year
- Reinforcement Learning for Repository-Level Code Completion☆43Aug 19, 2024Updated last year
- Code for Incorporating Relevance Feedback for Information-Seeking Retrieval using Few-Shot Document Re-Ranking, EMNLP 2022, https://aclan…☆14Mar 30, 2026Updated last month
- Landing page + leaderboard for SWE-Bench benchmark☆12Mar 29, 2026Updated last month
- ☆32Jan 14, 2025Updated last year
- [ASE'23] When Less is Enough: Positive-Unlabeled Learning Model for Vulnerability Detection☆16Jan 12, 2024Updated 2 years ago
- Violet: Selective Symbolic Execution to Detect Bad Performance Misconfiguration☆18Oct 16, 2020Updated 5 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Open sourced predictions, execution logs, trajectories, and results from model inference + evaluation runs on the SWE-bench task.☆262Mar 29, 2026Updated last month
- ☆69Dec 15, 2024Updated last year
- Train Ticket - A Benchmark Microservice System☆15Updated this week
- JISET: JavaScript IR-based Semantics Extraction Toolchain☆41Jan 7, 2023Updated 3 years ago
- ☆11Jan 19, 2025Updated last year
- Analyzing LLM Alignment via Token distribution shift☆18Jan 26, 2024Updated 2 years ago
- A lightweight library for Bayesian analysis of LLM evals (ICML 2025 Spotlight Position Paper)☆25May 28, 2025Updated 11 months ago