[NeurIPS 2024] Evaluation harness for SWT-Bench, a benchmark for evaluating LLM repository-level test-generation
☆92Oct 26, 2026Updated last week
Alternatives and similar repositories for swt-bench
Users that are interested in swt-bench are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- TestGenEval A Real World Unit Test Generation and Test Completion Benchmark☆37Mar 12, 2026Updated 7 months ago
- ☆108Jan 30, 2026Updated 9 months ago
- The official repo for the paper Can ChatGPT replace StackOverflow? A Study on Robustness and Reliability of Large Language Model Code Gen…☆20Feb 27, 2024Updated 2 years ago
- SWE-PolyBench: A multi-language benchmark for repository level evaluation of coding agents☆89Aug 14, 2026Updated 2 months ago
- [NeurIPS 2025 D&B] 🚀 SWE-bench Goes Live!☆261Sep 25, 2026Updated last month
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆143Jun 6, 2025Updated last year
- A toolkit for hybrid log parsing☆18Aug 23, 2023Updated 3 years ago
- Agentless Lite: RAG-based SWE-Bench software engineering scaffold☆48Apr 15, 2025Updated last year
- Evaluation code of ASE24 accepted paper "On the Evaluation of LLM in Unit Test Generation"☆13Dec 9, 2024Updated last year
- The repository for paper "DebugBench: "Evaluating Debugging Capability of Large Language Models".☆92Jul 13, 2024Updated 2 years ago
- [ESEC/FSE'23] Hue: A User-Adaptive Parser for Hybrid Logs☆10Aug 24, 2023Updated 3 years ago
- Implementation and datasets for "Training Language Models to Generate Quality Code with Program Analysis Feedback"☆43Jul 21, 2025Updated last year
- ☆28Jun 2, 2026Updated 5 months ago
- Code and data for the ICSE 2025 paper "HumanEvo: An Evolving-aware Benchmark for More Realistic Evaluation of Repository-level Code Gener…☆13Feb 10, 2025Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆11Jan 19, 2025Updated last year
- ☆19Apr 15, 2024Updated 2 years ago
- EvoEval: Evolving Coding Benchmarks via LLM☆84Apr 6, 2024Updated 2 years ago
- ⚙️ A tool for collecting executable code datasets with GitHub Actions ⚙️☆23Oct 26, 2026Updated last week
- Open-source repository for the OOPSLA'24 paper "CYCLE: Learning to Self-Refine Code Generation"☆10Mar 8, 2024Updated 2 years ago
- junit tools contest infrastructure☆13Feb 9, 2024Updated 2 years ago
- Code for Paper "Selecting Stickers in Open-Domain Dialogue through Multitask Learning"☆11Mar 3, 2022Updated 4 years ago
- ☆18Oct 15, 2026Updated 2 weeks ago
- ☆11Dec 1, 2024Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- A lightweight tool for detecting bugs on Graph Database Management Systems☆16Jan 9, 2024Updated 2 years ago
- ☆36May 25, 2023Updated 3 years ago
- ☆34Oct 2, 2024Updated 2 years ago
- ☆59Jan 28, 2025Updated last year
- Synthesized models for PHOG to make the results reproducible by the research community☆11Jan 23, 2020Updated 6 years ago
- DICE: Detecting In-distribution Data Contamination with LLM's Internal State☆11Sep 21, 2024Updated 2 years ago
- Code for "[COLM'25] RepoST: Scalable Repository-Level Coding Environment Construction with Sandbox Testing"☆24Mar 18, 2025Updated last year
- Multilingual Code Co-Evolution Using Large Language Models☆14Dec 8, 2024Updated last year
- ☆39Jan 27, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆39Jan 13, 2023Updated 3 years ago
- LongCLI-Bench's official repository☆49Aug 14, 2026Updated 2 months ago
- [NeurIPS 2025 D&B Spotlight] Scaling Data for SWE-agents☆820Oct 26, 2026Updated last week
- ☆60Dec 21, 2022Updated 3 years ago
- Data race skeletons from Uber's Go codebase for research in concurrency bug detection and analysis.☆11May 27, 2025Updated last year
- ☆15Nov 9, 2024Updated last year
- A Reproducible Benchmark of Recent Java Bugs☆54Aug 19, 2025Updated last year