[NeurIPS '25] GSO: Challenging Software Optimization Tasks for Evaluating SWE-Agents
☆92Jul 12, 2026Updated 2 months ago
Alternatives and similar repositories for gso
Users that are interested in gso are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [ICML '24] R2E: Turn any GitHub Repository into a Programming Agent Environment☆152Apr 20, 2025Updated last year
- Paper-reading notes for Berkeley OS prelim exam.☆14Aug 28, 2024Updated 2 years ago
- Benchmark harness and code for "SWE-fficiency: Can Language Models Optimize Real World Repositories on Real World Workloads?"☆26Feb 17, 2026Updated 7 months ago
- ☆13Mar 5, 2025Updated last year
- Code for Paper: Training Software Engineering Agents and Verifiers with SWE-Gym [ICML 2025]☆744Jul 29, 2025Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- [COLM 2025] Official repository for R2E-Gym: Procedural Environment Generation and Hybrid Verifiers for Scaling Open-Weights SWE Agents☆335Jul 13, 2025Updated last year
- A benchmark for evaluating LLMs on open-ended CS problems. Exploring the Next Frontier of Computer Science.☆318Sep 13, 2026Updated last week
- [NeurIPS 2025 D&B Spotlight] Scaling Data for SWE-agents☆784Updated this week
- Multi-SWE-bench: A Multilingual Benchmark for Issue Resolving☆362Dec 18, 2025Updated 9 months ago
- ☆58Jul 18, 2024Updated 2 years ago
- ☆53Oct 28, 2025Updated 10 months ago
- AlgoTune is a NeurIPS 2025 benchmark made up of 154 math, physics, and computer science problems. The goal is write code that solves each…☆117Jun 24, 2026Updated 3 months ago
- [NeurIPS'25] Official codebase for "SWE-RL: Advancing LLM Reasoning via Reinforcement Learning on Open Software Evolution"☆720Mar 16, 2025Updated last year
- ☆103Nov 22, 2025Updated 10 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆41Aug 2, 2026Updated last month
- ☆14Apr 24, 2024Updated 2 years ago
- A Difficulty-Calibrated Benchmark for Building Terminal Agents☆30Feb 20, 2026Updated 7 months ago
- Ideas for projects related to Tinker☆198Nov 6, 2025Updated 10 months ago
- Code for the paper "Rethinking Benchmark and Contamination for Language Models with Rephrased Samples"☆325Dec 20, 2023Updated 2 years ago
- Kubernetes Tutorial for the PS2 group meetings at UC Berkeley☆19Mar 23, 2023Updated 3 years ago
- ☆16Jan 23, 2026Updated 8 months ago
- [ICML 2026] Evaluating AI Agents on Continuous Software Evolution☆73Sep 3, 2026Updated 3 weeks ago
- FrontierSWE is an ultra long-horizon coding agent benchmark that tests implementation, performance eng and ML research☆230Aug 13, 2026Updated last month
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Small, simple agent task environments for training and evaluation☆20Nov 1, 2024Updated last year
- open source SWE-Atlas☆72Aug 20, 2026Updated last month
- ☆34Feb 28, 2026Updated 6 months ago
- ☆164Oct 16, 2025Updated 11 months ago
- ☆68May 19, 2025Updated last year
- Artifact repository for the paper "Lost in Translation: A Study of Bugs Introduced by Large Language Models while Translating Code", In P…☆54Apr 12, 2025Updated last year
- The Automated LLM Speedrunning Benchmark measures how well LLM agents can reproduce previous innovations and discover new ones in languag…☆146May 6, 2026Updated 4 months ago
- RepoQA: Evaluating Long-Context Code Understanding☆136Nov 1, 2024Updated last year
- [NeurIPS 2025 D&B] 🚀 SWE-bench Goes Live!☆243Sep 10, 2026Updated 2 weeks ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- This repository contains the Julia code for the paper "Competitive Gradient Descent"☆25Dec 18, 2019Updated 6 years ago
- EuroSys '24: "Trinity: A Fast Compressed Multi-attribute Data Store"☆18Mar 8, 2025Updated last year
- Code and benchmark of the paper "MineAnyBuild: Benchmarking Spatial Planning for Open-world AI Agents" (NeurIPS D&B 2025)☆17Oct 13, 2025Updated 11 months ago
- Vortex: Programmable Sparse Attention for Agents as Algorithm Designers☆69Aug 22, 2026Updated last month
- letta integration for terminalbench (#1 open source agent, in under 200 lines of code)☆19Oct 22, 2025Updated 11 months ago
- KernelBench: Can LLMs Write GPU Kernels? - Benchmark + Toolkit with Torch -> CUDA (+ more DSLs)☆1,256Mar 24, 2026Updated 6 months ago
- Efficient Long-context Language Model Training by Core Attention Disaggregation☆105Apr 7, 2026Updated 5 months ago