Alternatives and similar repositories for frontier-evals

Users that are interested in frontier-evals are comparing it to the libraries listed below

• openai / mle-bench
  MLE-bench is a benchmark for measuring how well AI agents perform at machine learning engineering
  ☆1,301Updated 3 weeks ago
• facebookresearch / swe-rl
  [NeurIPS'25] Official codebase for "SWE-RL: Advancing LLM Reasoning via Reinforcement Learning on Open Software Evolution"
  ☆675Updated 10 months ago
• SWE-Gym / SWE-Gym
  Code for Paper: Training Software Engineering Agents and Verifiers with SWE-Gym [ICML 2025]
  ☆627Updated 6 months ago
• TheAgentCompany / TheAgentCompany
  An agent benchmark with tasks in a simulated software company.
  ☆639Updated 2 months ago
• openai / SWELancer-Benchmark
  This repo contains the dataset and code for the paper "SWE-Lancer: Can Frontier LLMs Earn $1 Million from Real-World Freelance Software E…
  ☆1,439Updated 6 months ago
• microsoft / rStar
  ☆1,388Updated 4 months ago
• SWE-bench / SWE-smith
  [NeurIPS 2025 D&B Spotlight] Scaling Data for SWE-agents
  ☆538Updated last week
• open-thought / reasoning-gym
  [NeurIPS 2025 Spotlight] Reasoning Environments for Reinforcement Learning with Verifiable Rewards
  ☆1,332Updated 3 weeks ago
• facebookresearch / coconut
  Training Large Language Model to Reason in a Continuous Latent Space
  ☆1,496Updated 5 months ago
• sierra-research / tau2-bench
  τ²-Bench: Evaluating Conversational Agents in a Dual-Control Environment
  ☆736Updated this week
• thinking-machines-lab / tinker-cookbook
  Post-training with Tinker
  ☆2,826Updated this week
• laude-institute / terminal-bench
  A benchmark for LLMs on complicated tasks in the terminal
  ☆1,494Updated 2 weeks ago
• CharlesQ9 / Alita
  ☆874Updated 5 months ago
• facebookresearch / meta-agents-research-environments
  Meta Agents Research Environments is a comprehensive platform designed to evaluate AI agents in dynamic, realistic scenarios. Unlike stat…
  ☆427Updated 2 weeks ago
• qixucen / atom
  [NeurIPS 2025] Atom of Thoughts for Markov LLM Test-Time Scaling
  ☆641Updated this week
• NovaSky-AI / SkyRL
  SkyRL: A Modular Full-stack RL Library for LLMs
  ☆1,547Updated this week
• IntologyAI / Zochi
  Repository for Zochi's Research
  ☆300Updated 2 months ago
• facebookresearch / MLGym
  MLGym A New Framework and Benchmark for Advancing AI Research Agents
  ☆583Updated 6 months ago
• seal-rg / recurrent-pretraining
  Pretraining and inference code for a large-scale depth-recurrent language model
  ☆863Updated last month
• GAIR-NLP / LIMO
  [COLM 2025] LIMO: Less is More for Reasoning
  ☆1,062Updated 6 months ago
• SakanaAI / self-adaptive-llms
  A Self-adaptation Framework🐙 that adapts LLMs for unseen tasks in real-time!
  ☆1,187Updated last year
• ServiceNow / AgentLab
  AgentLab: An open-source framework for developing, testing, and benchmarking web agents on diverse tasks, designed for scalability and re…
  ☆509Updated 3 weeks ago
• Agent-RL / ReCall
  ReSearch: Learning to Reason with Search for LLMs via Reinforcement Learning & ReCall: Learning to Reason with Tool Call for LLMs via Rei…
  ☆1,317Updated 8 months ago
• laude-institute / harbor
  Harbor is a framework for running agent evaluations and creating and using RL environments.
  ☆600Updated this week
• google-deepmind / alphaevolve_results
  ☆259Updated last month
• sail-sg / oat
  🌾 OAT: A research-friendly framework for LLM online alignment, including reinforcement learning, preference learning, etc.
  ☆627Updated last week
• lyang36 / IMO25
  An AI agent system for solving International Mathematical Olympiad (IMO) problems using Google's Gemini, OpenAI, and XAI APIs.
  ☆908Updated 4 months ago
• Ayanami0730 / deep_research_bench
  DeepResearch Bench: A Comprehensive Benchmark for Deep Research Agents
  ☆576Updated this week
• NVIDIA-NeMo / Skills
  A project to improve skills of large language models
  ☆813Updated this week
• PrimeIntellect-ai / prime-rl
  Async RL Training at Scale
  ☆1,044Updated this week