eth-sri / matharenaLinks
Evaluation of LLMs on latest math competitions
☆216Updated this week
Alternatives and similar repositories for matharena
Users that are interested in matharena are comparing it to the libraries listed below
Sorting:
- ☆148Updated this week
- Can Language Models Solve Olympiad Programming?☆123Updated last year
- ☆191Updated 2 weeks ago
- Code for NeurIPS'24 paper 'Grokked Transformers are Implicit Reasoners: A Mechanistic Journey to the Edge of Generalization'☆235Updated 6 months ago
- A benchmark that challenges language models to code solutions for scientific problems☆169Updated 2 weeks ago
- Repository for the paper Stream of Search: Learning to Search in Language☆153Updated last year
- CodeElo: Benchmarking Competition-level Code Generation of LLMs with Human-comparable Elo Ratings☆65Updated last year
- ☆85Updated last year
- Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.☆189Updated 11 months ago
- A Collection of Competitive Text-Based Games for Language Model Evaluation and Reinforcement Learning☆350Updated last week
- ☆394Updated last week
- [ICML 2025] Flow of Reasoning: Training LLMs for Divergent Reasoning with Minimal Examples☆120Updated last week
- A simple unified framework for evaluating LLMs☆261Updated 9 months ago
- ☆90Updated 3 months ago
- ☆41Updated 10 months ago
- Reproducible, flexible LLM evaluations☆337Updated 2 weeks ago
- Open source interpretability artefacts for R1.☆170Updated 9 months ago
- ☆203Updated 9 months ago
- A scalable asynchronous reinforcement learning implementation with in-flight weight updates.☆361Updated this week
- ☆123Updated 11 months ago
- [COLM 2025] Official repository for R2E-Gym: Procedural Environment Generation and Hybrid Verifiers for Scaling Open-Weights SWE Agents☆236Updated 6 months ago
- Physics of Language Models: Part 4.2, Canon Layers at Scale where Synthetic Pretraining Resonates in Reality☆317Updated last month
- Replicating O1 inference-time scaling laws☆93Updated last year
- ☆114Updated 9 months ago
- ☆153Updated 5 months ago
- Code to reproduce "Transformers Can Do Arithmetic with the Right Embeddings", McLeish et al (NeurIPS 2024)☆198Updated last year
- Public repository for "The Surprising Effectiveness of Test-Time Training for Abstract Reasoning"☆344Updated 3 months ago
- ☆52Updated 10 months ago
- BABILong is a benchmark for LLM evaluation using the needle-in-a-haystack approach.☆238Updated 5 months ago
- Functional Benchmarks and the Reasoning Gap☆89Updated last year