Alternatives and similar repositories for matharena

Users that are interested in matharena are comparing it to the libraries listed below

• scicode-bench / SciCode
  A benchmark that challenges language models to code solutions for scientific problems
  ☆143Updated last week
• OSU-NLP-Group / GrokkedTransformer
  Code for NeurIPS'24 paper 'Grokked Transformers are Implicit Reasoners: A Mechanistic Journey to the Edge of Generalization'
  ☆230Updated 2 months ago
• QwenLM / CodeElo
  CodeElo: Benchmarking Competition-level Code Generation of LLMs with Human-comparable Elo Ratings
  ☆53Updated 8 months ago
• RulinShao / retrieval-scaling
  Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".
  ☆216Updated 2 months ago
• huggingface / ioi
  ☆39Updated 6 months ago
• facebookresearch / RAM
  A framework to study AI models in Reasoning, Alignment, and use of Memory (RAM).
  ☆290Updated last week
• ScalingIntelligence / Archon
  Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.
  ☆184Updated 6 months ago
• allenai / olmes
  Reproducible, flexible LLM evaluations
  ☆251Updated 2 months ago
• SalesforceAIResearch / LaTRO
  ☆123Updated 7 months ago
• allenai / OLMo-core
  PyTorch building blocks for the OLMo ecosystem
  ☆301Updated last week
• WildEval / ZeroEval
  A simple unified framework for evaluating LLMs
  ☆250Updated 5 months ago
• LeonGuertler / TextArena
  A Collection of Competitive Text-Based Games for Language Model Evaluation and Reinforcement Learning
  ☆281Updated last week
• hughbzhang / o1_inference_scaling_laws
  Replicating O1 inference-time scaling laws
  ☆90Updated 10 months ago
• kanishkg / stream-of-search
  Repository for the paper Stream of Search: Learning to Search in Language
  ☆151Updated 8 months ago
• ServiceNow / PipelineRL
  A scalable asynchronous reinforcement learning implementation with in-flight weight updates.
  ☆151Updated this week
• princeton-nlp / USACO
  Can Language Models Solve Olympiad Programming?
  ☆118Updated 8 months ago
• JacobPfau / fillerTokens
  ☆72Updated last year
• facebookresearch / meta-agents-research-environments
  Meta Agents Research Environments is a comprehensive platform designed to evaluate AI agents in dynamic, realistic scenarios. Unlike stat…
  ☆263Updated last week
• Yu-Fangxu / FoR
  [ICML 2025] Flow of Reasoning: Training LLMs for Divergent Reasoning with Minimal Examples
  ☆106Updated 2 months ago
• facebookresearch / PhysicsLM4
  Physics of Language Models, Part 4
  ☆247Updated 2 months ago
• google-deepmind / bbeh
  ☆94Updated 5 months ago
• ConsequentAI / fneval
  Functional Benchmarks and the Reasoning Gap
  ☆89Updated last year
• goodfire-ai / r1-interpretability
  Open source interpretability artefacts for R1.
  ☆160Updated 5 months ago
• JinjieNi / MixEval
  The official evaluation suite and dynamic data release for MixEval.
  ☆249Updated 10 months ago
• protagolabs / odyssey-math
  ☆84Updated 8 months ago
• R2E-Gym / R2E-Gym
  [COLM 2025] Official repository for R2E-Gym: Procedural Environment Generation and Hybrid Verifiers for Scaling Open-Weights SWE Agents
  ☆166Updated 2 months ago
• kyegomez / Lets-Verify-Step-by-Step
  "Improving Mathematical Reasoning with Process Supervision" by OPENAI
  ☆112Updated last week
• allenai / WildBench
  Benchmarking LLMs with Challenging Tasks from Real Users
  ☆241Updated 11 months ago
• MLE-Dojo / MLE-Dojo
  ☆74Updated last month
• InternLM / SWE-Fixer
  ☆118Updated 4 months ago