[NeurIPS '25] GSO: Challenging Software Optimization Tasks for Evaluating SWE-Agents
☆92Sep 29, 2026Updated 2 weeks ago
Alternatives and similar repositories for gso
Users that are interested in gso are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [ICML '24] R2E: Turn any GitHub Repository into a Programming Agent Environment☆152Apr 20, 2025Updated last year
- Paper-reading notes for Berkeley OS prelim exam.☆14Aug 28, 2024Updated 2 years ago
- Benchmark harness and code for "SWE-fficiency: Can Language Models Optimize Real World Repositories on Real World Workloads?"☆27Feb 17, 2026Updated 7 months ago
- ☆14Mar 5, 2025Updated last year
- Code for Paper: Training Software Engineering Agents and Verifiers with SWE-Gym [ICML 2025]☆748Jul 29, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- [COLM 2025] Official repository for R2E-Gym: Procedural Environment Generation and Hybrid Verifiers for Scaling Open-Weights SWE Agents☆337Jul 13, 2025Updated last year
- A benchmark for evaluating LLMs on open-ended CS problems. Exploring the Next Frontier of Computer Science.☆329Oct 3, 2026Updated last week
- [NeurIPS 2025 D&B Spotlight] Scaling Data for SWE-agents☆802Updated this week
- Multi-SWE-bench: A Multilingual Benchmark for Issue Resolving☆362Dec 18, 2025Updated 9 months ago
- ☆58Jul 18, 2024Updated 2 years ago
- ☆54Oct 28, 2025Updated 11 months ago
- AlgoTune is a NeurIPS 2025 benchmark made up of 154 math, physics, and computer science problems. The goal is write code that solves each…☆118Jun 24, 2026Updated 3 months ago
- [NeurIPS'25] Official codebase for "SWE-RL: Advancing LLM Reasoning via Reinforcement Learning on Open Software Evolution"☆720Mar 16, 2025Updated last year
- ☆107Nov 22, 2025Updated 10 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Rethinking RL for LLM Reasoning: It's Sparse Policy Selection, Not Capability Learning☆42Aug 2, 2026Updated 2 months ago
- ☆14Apr 24, 2024Updated 2 years ago
- A Difficulty-Calibrated Benchmark for Building Terminal Agents☆31Feb 20, 2026Updated 7 months ago
- Ideas for projects related to Tinker☆200Nov 6, 2025Updated 11 months ago
- Code for the paper "Rethinking Benchmark and Contamination for Language Models with Rephrased Samples"☆327Dec 20, 2023Updated 2 years ago
- Kubernetes Tutorial for the PS2 group meetings at UC Berkeley☆19Mar 23, 2023Updated 3 years ago
- ☆18Jan 23, 2026Updated 8 months ago
- Code repo for paper: Effective Strategies for Asynchronous Software Engineering Agents☆77Apr 2, 2026Updated 6 months ago
- FrontierSWE is an ultra long-horizon coding agent benchmark that tests implementation, performance eng and ML research☆232Aug 13, 2026Updated 2 months ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Small, simple agent task environments for training and evaluation☆20Nov 1, 2024Updated last year
- open source SWE-Atlas☆77Updated this week
- ☆34Feb 28, 2026Updated 7 months ago
- ☆170Oct 16, 2025Updated 11 months ago
- ☆68May 19, 2025Updated last year
- Artifact repository for the paper "Lost in Translation: A Study of Bugs Introduced by Large Language Models while Translating Code", In P…☆54Apr 12, 2025Updated last year
- The Automated LLM Speedrunning Benchmark measures how well LLM agents can reproduce previous innovations and discover new ones in languag…☆146May 6, 2026Updated 5 months ago
- RepoQA: Evaluating Long-Context Code Understanding☆138Nov 1, 2024Updated last year
- [NeurIPS 2025 D&B] 🚀 SWE-bench Goes Live!☆255Sep 25, 2026Updated 2 weeks ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- This repository contains the Julia code for the paper "Competitive Gradient Descent"☆25Dec 18, 2019Updated 6 years ago
- EuroSys '24: "Trinity: A Fast Compressed Multi-attribute Data Store"☆18Mar 8, 2025Updated last year
- Code and benchmark of the paper "MineAnyBuild: Benchmarking Spatial Planning for Open-world AI Agents" (NeurIPS D&B 2025)☆17Oct 13, 2025Updated last year
- Vortex: Programmable Sparse Attention for Agents as Algorithm Designers☆69Aug 22, 2026Updated last month
- letta integration for terminalbench (#1 open source agent, in under 200 lines of code)☆19Oct 22, 2025Updated 11 months ago
- KernelBench: Can LLMs Write GPU Kernels? - Benchmark + Toolkit with Torch -> CUDA (+ more DSLs)☆1,289Mar 24, 2026Updated 6 months ago
- Can Language Models Rebuild Programs From Scratch?☆953Updated this week