Alternatives and similar repositories for frontier-evals

Users that are interested in frontier-evals are comparing it to the libraries listed below

• openai / mle-bench
  MLE-bench is a benchmark for measuring how well AI agents perform at machine learning engineering
  ☆1,178Updated this week
• facebookresearch / swe-rl
  [NeurIPS'25] Official codebase for "SWE-RL: Advancing LLM Reasoning via Reinforcement Learning on Open Software Evolution"
  ☆616Updated 8 months ago
• thinking-machines-lab / tinker-cookbook
  Post-training with Tinker
  ☆1,932Updated this week
• laude-institute / terminal-bench
  A benchmark for LLMs on complicated tasks in the terminal
  ☆1,069Updated this week
• SWE-Gym / SWE-Gym
  Code for Paper: Training Software Engineering Agents and Verifiers with SWE-Gym [ICML 2025]
  ☆573Updated 3 months ago
• facebookresearch / coconut
  Training Large Language Model to Reason in a Continuous Latent Space
  ☆1,327Updated 3 months ago
• facebookresearch / MLGym
  MLGym A New Framework and Benchmark for Advancing AI Research Agents
  ☆568Updated 3 months ago
• microsoft / rStar
  ☆1,335Updated 2 months ago
• seal-rg / recurrent-pretraining
  Pretraining and inference code for a large-scale depth-recurrent language model
  ☆843Updated last month
• google-deepmind / alphaevolve_results
  ☆233Updated 4 months ago
• NovaSky-AI / SkyRL
  SkyRL: A Modular Full-stack RL Library for LLMs
  ☆1,202Updated this week
• openai / SWELancer-Benchmark
  This repo contains the dataset and code for the paper "SWE-Lancer: Can Frontier LLMs Earn $1 Million from Real-World Freelance Software E…
  ☆1,439Updated 4 months ago
• CharlesQ9 / Alita
  ☆846Updated 2 months ago
• qixucen / atom
  [NeurIPS 2025] Atom of Thoughts for Markov LLM Test-Time Scaling
  ☆596Updated 5 months ago
• IntologyAI / Zochi
  Repository for Zochi's Research
  ☆283Updated 2 months ago
• open-thought / reasoning-gym
  [NeurIPS 2025 Spotlight] Reasoning Environments for Reinforcement Learning with Verifiable Rewards
  ☆1,214Updated last month
• facebookresearch / meta-agents-research-environments
  Meta Agents Research Environments is a comprehensive platform designed to evaluate AI agents in dynamic, realistic scenarios. Unlike stat…
  ☆348Updated last week
• TheAgentCompany / TheAgentCompany
  An agent benchmark with tasks in a simulated software company.
  ☆581Updated last month
• ServiceNow / AgentLab
  AgentLab: An open-source framework for developing, testing, and benchmarking web agents on diverse tasks, designed for scalability and re…
  ☆469Updated last week
• hijohnnylin / neuronpedia
  open source interpretability platform 🧠
  ☆486Updated this week
• SWE-bench / SWE-smith
  [NeurIPS 2025 D&B Spotlight] Scaling Data for SWE-agents
  ☆451Updated this week
• hkust-nlp / CodeIO
  [ICML 2025 Oral] CodeI/O: Condensing Reasoning Patterns via Code Input-Output Prediction
  ☆558Updated 6 months ago
• SakanaAI / self-adaptive-llms
  A Self-adaptation Framework🐙 that adapts LLMs for unseen tasks in real-time!
  ☆1,162Updated 9 months ago
• arcprize / arc-agi-benchmarking
  Testing baseline LLMs performance across various models
  ☆317Updated this week
• sierra-research / tau2-bench
  τ²-Bench: Evaluating Conversational Agents in a Dual-Control Environment
  ☆412Updated last week
• LiveCodeBench / LiveCodeBench
  Official repository for the paper "LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code"
  ☆708Updated 4 months ago
• safety-research / circuit-tracer
  ☆2,432Updated 2 weeks ago
• sierra-research / tau-bench
  Code and Data for Tau-Bench
  ☆942Updated 2 months ago
• idavidrein / gpqa
  GPQA: A Graduate-Level Google-Proof Q&A Benchmark
  ☆425Updated last year
• ByteDance-Seed / Seed-Thinking-v1.5
  ☆817Updated 5 months ago