Alternatives and similar repositories for matharena

Users that are interested in matharena are comparing it to the libraries listed below

• scicode-bench / SciCode
  A benchmark that challenges language models to code solutions for scientific problems
  ☆124Updated 2 weeks ago
• SalesforceAIResearch / LaTRO
  ☆115Updated 4 months ago
• ScalingIntelligence / Archon
  Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.
  ☆173Updated 3 months ago
• da03 / Internalize_CoT_Step_by_Step
  ☆180Updated 2 months ago
• princeton-nlp / USACO
  Can Language Models Solve Olympiad Programming?
  ☆116Updated 5 months ago
• hughbzhang / o1_inference_scaling_laws
  Replicating O1 inference-time scaling laws
  ☆87Updated 6 months ago
• google-deepmind / mishax
  ☆134Updated 2 months ago
• ServiceNow / PipelineRL
  A scalable asynchronous reinforcement learning implementation with in-flight weight updates.
  ☆125Updated this week
• ucl-dark / llm_debate
  Code release for "Debating with More Persuasive LLMs Leads to More Truthful Answers"
  ☆109Updated last year
• EleutherAI / delphi
  Delphi was the home of a temple to Phoebus Apollo, which famously had the inscription, 'Know Thyself.' This library lets language models …
  ☆185Updated this week
• google-deepmind / bbeh
  ☆78Updated last month
• kanishkg / stream-of-search
  Repository for the paper Stream of Search: Learning to Search in Language
  ☆148Updated 4 months ago
• protagolabs / odyssey-math
  ☆83Updated 5 months ago
• Yu-Fangxu / FoR
  [ICML 2025] Flow of Reasoning: Training LLMs for Divergent Reasoning with Minimal Examples
  ☆95Updated 2 weeks ago
• TIGER-AI-Lab / General-Reasoner
  General Reasoner: Advancing LLM Reasoning Across All Domains
  ☆141Updated 2 weeks ago
• allenai / olmes
  Reproducible, flexible LLM evaluations
  ☆213Updated last month
• expz / quiet-star
  Implementation of the Quiet-STAR paper (https://arxiv.org/pdf/2403.09629.pdf)
  ☆54Updated 10 months ago
• R2E-Gym / R2E-Gym
  Official repository for R2E-Gym: Procedural Environment Generation and Hybrid Verifiers for Scaling Open-Weights SWE Agents
  ☆76Updated 2 weeks ago
• McGill-NLP / VinePPO
  Code for the paper "VinePPO: Unlocking RL Potential For LLM Reasoning Through Refined Credit Assignment"
  ☆161Updated 3 weeks ago
• laude-institute / terminal-bench
  A benchmark for LLMs on complicated tasks in the terminal
  ☆177Updated this week
• felipemaiapolo / tinyBenchmarks
  Evaluating LLMs with fewer examples
  ☆158Updated last year
• booydar / babilong
  BABILong is a benchmark for LLM evaluation using the needle-in-a-haystack approach.
  ☆203Updated last month
• JacobPfau / fillerTokens
  ☆65Updated last year
• zjunlp / KnowledgeCircuits
  [NeurIPS 2024] Knowledge Circuits in Pretrained Transformers
  ☆148Updated 4 months ago
• agentica-project / verl-pipeline
  Async pipelined version of Verl
  ☆100Updated 2 months ago
• WildEval / ZeroEval
  A simple unified framework for evaluating LLMs
  ☆219Updated 2 months ago
• JoshEngels / MultiDimensionalFeatures
  Code for reproducing our paper "Not All Language Model Features Are Linear"
  ☆75Updated 6 months ago
• METR / RE-Bench
  ☆84Updated 2 months ago
• NovaSky-AI / SkyRL
  SkyRL-v0: Train Real-World Long-Horizon Agents via Reinforcement Learning
  ☆422Updated this week
• OSU-NLP-Group / GrokkedTransformer
  Code for NeurIPS'24 paper 'Grokked Transformers are Implicit Reasoners: A Mechanistic Journey to the Edge of Generalization'
  ☆218Updated 6 months ago