Alternatives and similar repositories for matharena

Users that are interested in matharena are comparing it to the libraries listed below

• LeonGuertler / TextArena
  A Collection of Competitive Text-Based Games for Language Model Evaluation and Reinforcement Learning
  ☆207Updated this week
• scicode-bench / SciCode
  A benchmark that challenges language models to code solutions for scientific problems
  ☆127Updated last week
• WildEval / ZeroEval
  A simple unified framework for evaluating LLMs
  ☆221Updated 3 months ago
• allenai / OLMo-core
  PyTorch building blocks for the OLMo ecosystem
  ☆258Updated this week
• OSU-NLP-Group / GrokkedTransformer
  Code for NeurIPS'24 paper 'Grokked Transformers are Implicit Reasoners: A Mechanistic Journey to the Edge of Generalization'
  ☆223Updated 7 months ago
• allenai / olmes
  Reproducible, flexible LLM evaluations
  ☆219Updated this week
• RulinShao / retrieval-scaling
  Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".
  ☆206Updated last month
• princeton-nlp / USACO
  Can Language Models Solve Olympiad Programming?
  ☆119Updated 6 months ago
• SalesforceAIResearch / LaTRO
  ☆117Updated 4 months ago
• hughbzhang / o1_inference_scaling_laws
  Replicating O1 inference-time scaling laws
  ☆89Updated 7 months ago
• da03 / Internalize_CoT_Step_by_Step
  ☆181Updated 2 months ago
• JacobPfau / fillerTokens
  ☆66Updated last year
• kanishkg / stream-of-search
  Repository for the paper Stream of Search: Learning to Search in Language
  ☆149Updated 5 months ago
• ServiceNow / PipelineRL
  A scalable asynchronous reinforcement learning implementation with in-flight weight updates.
  ☆129Updated this week
• allenai / WildBench
  Benchmarking LLMs with Challenging Tasks from Real Users
  ☆228Updated 8 months ago
• mlfoundations / scaling
  Language models scale reliably with over-training and on downstream tasks
  ☆97Updated last year
• goodfire-ai / r1-interpretability
  Open source interpretability artefacts for R1.
  ☆154Updated 2 months ago
• ScalingIntelligence / Archon
  Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.
  ☆173Updated 4 months ago
• mcleish7 / arithmetic
  Code to reproduce "Transformers Can Do Arithmetic with the Right Embeddings", McLeish et al (NeurIPS 2024)
  ☆190Updated last year
• huggingface / ioi
  ☆35Updated 3 months ago
• ScalingIntelligence / large_language_monkeys
  ☆96Updated 9 months ago
• BigComputer-Project / SWE-Arena
  SWE Arena
  ☆34Updated last week
• ekinakyurek / marc
  Public repository for "The Surprising Effectiveness of Test-Time Training for Abstract Reasoning"
  ☆318Updated 7 months ago
• booydar / babilong
  BABILong is a benchmark for LLM evaluation using the needle-in-a-haystack approach.
  ☆203Updated 2 months ago
• suzgunmirac / dynamic-cheatsheet
  Dynamic Cheatsheet: Test-Time Learning with Adaptive Memory
  ☆66Updated last month
• expz / quiet-star
  Implementation of the Quiet-STAR paper (https://arxiv.org/pdf/2403.09629.pdf)
  ☆54Updated 11 months ago
• google-deepmind / bbeh
  ☆83Updated 2 months ago
• sunblaze-ucb / Intuitor
  Code for the paper: "Learning to Reason without External Rewards"
  ☆319Updated this week
• THUDM / T1
  RL Scaling and Test-Time Scaling (ICML'25)
  ☆108Updated 5 months ago
• R2E-Gym / R2E-Gym
  Official repository for R2E-Gym: Procedural Environment Generation and Hybrid Verifiers for Scaling Open-Weights SWE Agents
  ☆112Updated last week