FrontierSWE is an ultra long-horizon coding agent benchmark that tests implementation, performance eng and ML research
☆235Oct 22, 2026Updated this week
Alternatives and similar repositories for frontier-swe
Users that are interested in frontier-swe are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- SWE-Marathon: an ultra long-horizon SWE benchmark☆169Updated this week
- ☆44Sep 21, 2026Updated last month
- Measuring how well CLI agents like Claude Code or Codex CLI can post-train base LLMs on a single H100 GPU in 10 hours☆602Oct 2, 2026Updated 3 weeks ago
- ☆186May 13, 2026Updated 5 months ago
- Official eval scripts for JobBench☆64Oct 6, 2026Updated 2 weeks ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- [ICML 2026] SWE-ABS: Adversarial Benchmark Strengthening Exposes Inflated Success Rates on Test-based Benchmark☆25May 6, 2026Updated 5 months ago
- Can Language Models Rebuild Programs From Scratch?☆970Oct 12, 2026Updated last week
- [ICLR 2026] Official Implementation of "FeatureBench: Benchmarking Agentic Coding for Complex Feature Development"☆99Sep 15, 2026Updated last month
- Continual Learning Bench☆229Jul 19, 2026Updated 3 months ago
- ☆84Jun 25, 2026Updated 3 months ago
- FrontierSmith, a new system that uses AI to synthesize open-ended coding problems at scale☆84Updated this week
- [ICLR 2026] The Tool Decathlon: Benchmarking Language Agents for Diverse, Realistic, and Long-Horizon Task Execution☆504Aug 18, 2026Updated 2 months ago
- A benchmark for evaluating AI agents on realistic business workflows☆352Aug 4, 2026Updated 2 months ago
- Measuring frontier coding agents on original, long-horizon engineering tasks☆1,857Aug 26, 2026Updated last month
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Measuring and evolving with the frontier of agent work☆952Updated this week
- ☆15Jul 17, 2026Updated 3 months ago
- [ICML 2026] RLVE: Scaling Up Reinforcement Learning for Language Models with Adaptive Verifiable Environments☆249Apr 30, 2026Updated 5 months ago
- open source SWE-Atlas☆82Oct 13, 2026Updated last week
- RSI-Exam: Measuring Recursive Self-Improvement on Long-Horizon, Executable Research Tasks · Discord https://discord.gg/FBzhepyE☆189Updated this week
- KernelBench: Can LLMs Write GPU Kernels? - Benchmark + Toolkit with Torch -> CUDA (+ more DSLs)☆1,297Mar 24, 2026Updated 6 months ago
- A benchmark for evaluating LLMs on open-ended CS problems. Exploring the Next Frontier of Computer Science.☆335Updated this week
- Framework for evaluating and improving agents☆6,335Updated this week
- [NeurIPS '25] GSO: Challenging Software Optimization Tasks for Evaluating SWE-Agents☆92Sep 29, 2026Updated 3 weeks ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- A framework for building robust RL environments to train aligned AI.☆143Oct 16, 2026Updated last week
- Terminal-Bench-Science: Evaluating AI agents on research workflows across scientific domains☆752Updated this week
- ☆95Jul 21, 2026Updated 3 months ago
- Convert GitHub PRs into Harbor tasks☆89Jul 13, 2026Updated 3 months ago
- Phi-Bench (Φ-Bench): 85 open-source LLM-infrastructure engineering tasks for frontier LLMs & coding agents (KFC/LH/E2E). Self-contained p…☆69Oct 13, 2026Updated last week
- Gym-Anything: Turn any Software into an Agent Environment☆295Oct 14, 2026Updated last week
- A benchmark for LLMs on complicated tasks in the terminal☆2,604Jul 11, 2026Updated 3 months ago
- ☆27Jan 22, 2026Updated 9 months ago
- Code for Paper: Training Software Engineering Agents and Verifiers with SWE-Gym [ICML 2025]☆752Jul 29, 2025Updated last year
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- [NeurIPS 2025 D&B Spotlight] Scaling Data for SWE-agents☆812Updated this week
- Miles is an enterprise-facing reinforcement learning framework for LLM and VLM post-training, forked from and co-evolving with slime.☆3,182Updated this week
- ☆14Aug 18, 2022Updated 4 years ago
- Benchmark of LLMs on real open-source projects against dependency hell, legacy toolchains, and complex build systems.☆60Jul 14, 2026Updated 3 months ago
- Tools and prompt templates used to build and evaluate SWE-rebench-v2 tasks for the paper.☆87Mar 12, 2026Updated 7 months ago
- ☆25Jun 18, 2026Updated 4 months ago
- Official Implementation of ACL2023: Don't Parse, Choose Spans! Continuous and Discontinuous Constituency Parsing via Autoregressive Span …☆14Aug 25, 2023Updated 3 years ago