openai / frontier-evalsLinks
OpenAI Frontier Evals
☆983Updated last month
Alternatives and similar repositories for frontier-evals
Users that are interested in frontier-evals are comparing it to the libraries listed below
Sorting:
- [NeurIPS'25] Official codebase for "SWE-RL: Advancing LLM Reasoning via Reinforcement Learning on Open Software Evolution"☆654Updated 10 months ago
- MLE-bench is a benchmark for measuring how well AI agents perform at machine learning engineering☆1,276Updated this week
- Code for Paper: Training Software Engineering Agents and Verifiers with SWE-Gym [ICML 2025]☆613Updated 5 months ago
- ☆1,376Updated 4 months ago
- A benchmark for LLMs on complicated tasks in the terminal☆1,350Updated 3 weeks ago
- This repo contains the dataset and code for the paper "SWE-Lancer: Can Frontier LLMs Earn $1 Million from Real-World Freelance Software E…☆1,437Updated 6 months ago
- SkyRL: A Modular Full-stack RL Library for LLMs☆1,456Updated this week
- An agent benchmark with tasks in a simulated software company.☆622Updated 2 months ago
- Training Large Language Model to Reason in a Continuous Latent Space☆1,449Updated 5 months ago
- Post-training with Tinker☆2,719Updated this week
- [NeurIPS 2025 D&B Spotlight] Scaling Data for SWE-agents☆514Updated this week
- τ²-Bench: Evaluating Conversational Agents in a Dual-Control Environment☆631Updated last month
- Async RL Training at Scale☆1,005Updated this week
- [NeurIPS 2025 Spotlight] Reasoning Environments for Reinforcement Learning with Verifiable Rewards☆1,304Updated last month
- A project to improve skills of large language models☆756Updated last week
- Meta Agents Research Environments is a comprehensive platform designed to evaluate AI agents in dynamic, realistic scenarios. Unlike stat…☆410Updated 2 months ago
- ☆254Updated last week
- AgentLab: An open-source framework for developing, testing, and benchmarking web agents on diverse tasks, designed for scalability and re…☆494Updated this week
- Code and Data for Tau-Bench☆1,058Updated 4 months ago
- Repository for Zochi's Research☆299Updated last month
- Pretraining and inference code for a large-scale depth-recurrent language model☆859Updated 2 weeks ago
- ☆867Updated 4 months ago
- [ICML 2025 Oral] CodeI/O: Condensing Reasoning Patterns via Code Input-Output Prediction☆566Updated 8 months ago
- A Self-adaptation Framework🐙 that adapts LLMs for unseen tasks in real-time!☆1,179Updated 11 months ago
- Official repository for the paper "LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code"☆762Updated 6 months ago
- Harbor is a framework for running agent evaluations and creating and using RL environments.☆381Updated this week
- [COLM 2025] LIMO: Less is More for Reasoning☆1,061Updated 5 months ago
- MLGym A New Framework and Benchmark for Advancing AI Research Agents☆584Updated 5 months ago
- ☆483Updated 6 months ago
- [NeurIPS 2025] Atom of Thoughts for Markov LLM Test-Time Scaling☆631Updated last month