Alternatives and similar repositories for matharena

Users that are interested in matharena are comparing it to the libraries listed below

• scicode-bench / SciCode
  A benchmark that challenges language models to code solutions for scientific problems
  ☆157Updated this week
• SalesforceAIResearch / LaTRO
  ☆124Updated 9 months ago
• princeton-nlp / USACO
  Can Language Models Solve Olympiad Programming?
  ☆122Updated 10 months ago
• QwenLM / CodeElo
  CodeElo: Benchmarking Competition-level Code Generation of LLMs with Human-comparable Elo Ratings
  ☆57Updated 10 months ago
• ScalingIntelligence / Archon
  Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.
  ☆189Updated 9 months ago
• kanishkg / stream-of-search
  Repository for the paper Stream of Search: Learning to Search in Language
  ☆151Updated 10 months ago
• hughbzhang / o1_inference_scaling_laws
  Replicating O1 inference-time scaling laws
  ☆90Updated last year
• da03 / Internalize_CoT_Step_by_Step
  ☆200Updated 7 months ago
• LeonGuertler / TextArena
  A Collection of Competitive Text-Based Games for Language Model Evaluation and Reinforcement Learning
  ☆319Updated last month
• OSU-NLP-Group / GrokkedTransformer
  Code for NeurIPS'24 paper 'Grokked Transformers are Implicit Reasoners: A Mechanistic Journey to the Edge of Generalization'
  ☆234Updated 4 months ago
• allenai / olmes
  Reproducible, flexible LLM evaluations
  ☆293Updated 2 weeks ago
• goodfire-ai / r1-interpretability
  Open source interpretability artefacts for R1.
  ☆164Updated 7 months ago
• ConsequentAI / fneval
  Functional Benchmarks and the Reasoning Gap
  ☆90Updated last year
• protagolabs / odyssey-math
  ☆85Updated 10 months ago
• google-deepmind / bbeh
  ☆105Updated 7 months ago
• huggingface / ioi
  ☆41Updated 8 months ago
• ServiceNow / PipelineRL
  A scalable asynchronous reinforcement learning implementation with in-flight weight updates.
  ☆322Updated this week
• WildEval / ZeroEval
  A simple unified framework for evaluating LLMs
  ☆254Updated 7 months ago
• mlfoundations / scaling
  Language models scale reliably with over-training and on downstream tasks
  ☆100Updated last year
• RulinShao / retrieval-scaling
  Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".
  ☆220Updated last month
• MLE-Dojo / MLE-Dojo
  ☆82Updated last month
• hamishivi / EasyLM
  Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…
  ☆76Updated last year
• mcleish7 / arithmetic
  Code to reproduce "Transformers Can Do Arithmetic with the Right Embeddings", McLeish et al (NeurIPS 2024)
  ☆195Updated last year
• InternLM / SWE-Fixer
  ☆128Updated 7 months ago
• JacobPfau / fillerTokens
  ☆75Updated last year
• ekinakyurek / marc
  Public repository for "The Surprising Effectiveness of Test-Time Training for Abstract Reasoning"
  ☆340Updated 3 weeks ago
• facebookresearch / PhysicsLM4
  Physics of Language Models, Part 4
  ☆262Updated 4 months ago
• Yu-Fangxu / FoR
  [ICML 2025] Flow of Reasoning: Training LLMs for Divergent Reasoning with Minimal Examples
  ☆112Updated 4 months ago
• imagination-research / lbt
  [NeurIPS 2024] Can LLMs Learn by Teaching for Better Reasoning? A Preliminary Study
  ☆56Updated last year
• METR / RE-Bench
  ☆119Updated last month