[NeurIPS '25] GSO: Challenging Software Optimization Tasks for Evaluating SWE-Agents
☆90Jul 12, 2026Updated last month
Alternatives and similar repositories for gso
Users that are interested in gso are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [ICML '24] R2E: Turn any GitHub Repository into a Programming Agent Environment☆151Apr 20, 2025Updated last year
- Paper-reading notes for Berkeley OS prelim exam.☆14Aug 28, 2024Updated last year
- Benchmark harness and code for "SWE-fficiency: Can Language Models Optimize Real World Repositories on Real World Workloads?"☆22Feb 17, 2026Updated 5 months ago
- ☆13Mar 5, 2025Updated last year
- Code for Paper: Training Software Engineering Agents and Verifiers with SWE-Gym [ICML 2025]☆721Jul 29, 2025Updated last year
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- [COLM 2025] Official repository for R2E-Gym: Procedural Environment Generation and Hybrid Verifiers for Scaling Open-Weights SWE Agents☆318Jul 13, 2025Updated last year
- A benchmark for evaluating LLMs on open-ended CS problems. Exploring the Next Frontier of Computer Science.☆292Updated this week
- [NeurIPS 2025 D&B Spotlight] Scaling Data for SWE-agents☆740Updated this week
- Multi-SWE-bench: A Multilingual Benchmark for Issue Resolving☆355Dec 18, 2025Updated 7 months ago
- ☆59Jul 18, 2024Updated 2 years ago
- ☆53Oct 28, 2025Updated 9 months ago
- AlgoTune is a NeurIPS 2025 benchmark made up of 154 math, physics, and computer science problems. The goal is write code that solves each…☆114Jun 24, 2026Updated last month
- [NeurIPS'25] Official codebase for "SWE-RL: Advancing LLM Reasoning via Reinforcement Learning on Open Software Evolution"☆717Mar 16, 2025Updated last year
- ☆102Nov 22, 2025Updated 8 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆20Aug 2, 2026Updated last week
- ☆14Apr 24, 2024Updated 2 years ago
- A Difficulty-Calibrated Benchmark for Building Terminal Agents☆30Feb 20, 2026Updated 5 months ago
- Ideas for projects related to Tinker☆195Nov 6, 2025Updated 9 months ago
- Code for the paper "Rethinking Benchmark and Contamination for Language Models with Rephrased Samples"☆325Dec 20, 2023Updated 2 years ago
- Kubernetes Tutorial for the PS2 group meetings at UC Berkeley☆18Mar 23, 2023Updated 3 years ago
- ☆16Jan 23, 2026Updated 6 months ago
- A Continuous Task Evaluation Playground for AI Harness☆69Aug 1, 2026Updated 2 weeks ago
- Code repo for paper: Effective Strategies for Asynchronous Software Engineering Agents☆69Apr 2, 2026Updated 4 months ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- FrontierSWE is an ultra long-horizon coding agent benchmark that tests implementation, performance eng and ML research☆212Updated this week
- Small, simple agent task environments for training and evaluation☆20Nov 1, 2024Updated last year
- open source SWE-Atlas☆67Jul 20, 2026Updated 3 weeks ago
- ☆33Feb 28, 2026Updated 5 months ago
- ☆63May 19, 2025Updated last year
- ☆153Oct 16, 2025Updated 9 months ago
- Code and benchmark of the paper "MineAnyBuild: Benchmarking Spatial Planning for Open-world AI Agents" (NeurIPS D&B 2025)☆15Oct 13, 2025Updated 10 months ago
- Artifact repository for the paper "Lost in Translation: A Study of Bugs Introduced by Large Language Models while Translating Code", In P…☆54Apr 12, 2025Updated last year
- The Automated LLM Speedrunning Benchmark measures how well LLM agents can reproduce previous innovations and discover new ones in languag…☆146May 6, 2026Updated 3 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- [NeurIPS 2025 D&B] 🚀 SWE-bench Goes Live!☆220Jun 11, 2026Updated 2 months ago
- RepoQA: Evaluating Long-Context Code Understanding☆136Nov 1, 2024Updated last year
- This repository contains the Julia code for the paper "Competitive Gradient Descent"☆25Dec 18, 2019Updated 6 years ago
- EuroSys '24: "Trinity: A Fast Compressed Multi-attribute Data Store"☆18Mar 8, 2025Updated last year
- Examples and instructions about use LLMs (especially ChatGPT) for PhD☆104Mar 18, 2023Updated 3 years ago
- Vortex: Programmable Sparse Attention for Agents as Algorithm Designers☆68Updated this week
- KernelBench: Can LLMs Write GPU Kernels? - Benchmark + Toolkit with Torch -> CUDA (+ more DSLs)☆1,199Mar 24, 2026Updated 4 months ago