SWE-PolyBench: A multi-language benchmark for repository level evaluation of coding agents
☆90Aug 14, 2026Updated last month
Alternatives and similar repositories for SWE-PolyBench
Users that are interested in SWE-PolyBench are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Official implementation for the paper, StackEval: Benchmarking LLMs in Coding Assistance, https://arxiv.org/abs/2412.05288☆22Oct 30, 2024Updated last year
- Multi-SWE-bench: A Multilingual Benchmark for Issue Resolving☆362Dec 18, 2025Updated 9 months ago
- Code for Paper: Training Software Engineering Agents and Verifiers with SWE-Gym [ICML 2025]☆748Jul 29, 2025Updated last year
- Cloud serverless implementations of AWS Strands Agents.☆17Jun 20, 2025Updated last year
- Run SWE-bench evaluations remotely☆83Aug 14, 2025Updated last year
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- ☆11Sep 7, 2023Updated 3 years ago
- [NeurIPS 2024] Evaluation harness for SWT-Bench, a benchmark for evaluating LLM repository-level test-generation☆91Jul 23, 2026Updated 2 months ago
- [NeurIPS 2025 D&B Spotlight] Scaling Data for SWE-agents☆801Updated this week
- Agentless Lite: RAG-based SWE-Bench software engineering scaffold☆49Apr 15, 2025Updated last year
- LLM benchmarks☆13Feb 22, 2024Updated 2 years ago
- ☆60Jul 10, 2026Updated 3 months ago
- ☆15Mar 8, 2026Updated 7 months ago
- A unified API for orchestrating and provisioning compute capacity. Define what you need in a template, request it, track it and return it…☆18Updated this week
- ☆43Jul 6, 2026Updated 3 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Benchmark for issue resolutions in agent systems.☆21Apr 30, 2026Updated 5 months ago
- [FSE'2026] SWE-Factory: Your Automated Factory for Issue Resolution Training Data and Evaluation Benchmarks☆198May 12, 2026Updated 5 months ago
- Python module that creates a context map for AI code generation☆32Aug 14, 2024Updated 2 years ago
- Experimental: Robot Control for Strands Agents.☆23Mar 4, 2026Updated 7 months ago
- A CDK sqs-redrive construct☆16Apr 11, 2024Updated 2 years ago
- ☆42May 26, 2026Updated 4 months ago
- SWE-bench: Can Language Models Resolve Real-world Github Issues?☆6,020Sep 18, 2026Updated 3 weeks ago
- CLI tools for maintaining Markdown content like documentation and tutorials☆23Sep 12, 2026Updated last month
- Sandboxed code execution for AI agents, locally or on the cloud. Massively parallel, easy to extend. Powering SWE-agent and more.☆618Updated this week
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- [NeurIPS 2025 D&B] 🚀 SWE-bench Goes Live!☆254Sep 25, 2026Updated 2 weeks ago
- [ASE 2025] CoSIL: Issue Localization via Iteritive Code Graph Searching☆26May 31, 2026Updated 4 months ago
- C++ implementation of the OSPF routing protocol☆18Jun 30, 2015Updated 11 years ago
- ☆48May 29, 2026Updated 4 months ago
- open source SWE-Atlas☆77Updated this week
- Serverless Webhook Forwarder☆16Sep 19, 2026Updated 3 weeks ago
- OmniCode: A Diverse Software Engineering Benchmark for Evaluating Large Language Models☆27Apr 17, 2026Updated 5 months ago
- Building an Intelligent AWS Cloud Engineer Agent with Strands Agents SDK☆29Dec 16, 2025Updated 9 months ago
- Landing page + leaderboard for SWE-Bench benchmark☆15Sep 1, 2026Updated last month
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- ☆16Aug 18, 2025Updated last year
- [COLM 2025] Official repository for R2E-Gym: Procedural Environment Generation and Hybrid Verifiers for Scaling Open-Weights SWE Agents☆337Jul 13, 2025Updated last year
- [AAAI 2025 oral] Evaluating Mathematical Reasoning Beyond Accuracy☆80Oct 9, 2025Updated last year
- Examples for consuming Private API Gateway across AWS Accounts☆25Oct 5, 2026Updated last week
- The CloudFormation templates included in this repository are intended to assist you in configuring and installing Amazon CloudWatch and A…☆18Feb 10, 2025Updated last year
- [ACL 2025] Knowledge Unlearning for Large Language Models☆49Sep 18, 2025Updated last year
- Code for 'Answer Matching Outperforms Multiple Choice for Language Model Evaluation' paper☆20Jul 4, 2025Updated last year