eth-sri / matharena
Evaluation of LLMs on latest math competitions
☆119Updated last week
Alternatives and similar repositories for matharena:
Users that are interested in matharena are comparing it to the libraries listed below
- Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".☆199Updated this week
- Replicating O1 inference-time scaling laws☆85Updated 5 months ago
- ☆114Updated 2 months ago
- SkyRL-v0: Train Real-World Long-Horizon Agents via Reinforcement Learning☆180Updated this week
- A scalable asynchronous reinforcement learning implementation with in-flight weight updates.☆100Updated this week
- ☆170Updated 3 weeks ago
- ☆69Updated this week
- General Reasoner: Advancing LLM Reasoning Across All Domains☆77Updated this week
- A Collection of Competitive Text-Based Games for Language Model Evaluation and Reinforcement Learning☆153Updated this week
- ☆50Updated 11 months ago
- The HELMET Benchmark☆142Updated 3 weeks ago
- Official repository for R2E-Gym: Procedural Environment Generation and Hybrid Verifiers for Scaling Open-Weights SWE Agents☆67Updated 2 weeks ago
- ☆65Updated 2 months ago
- ☆60Updated last year
- Code for NeurIPS'24 paper 'Grokked Transformers are Implicit Reasoners: A Mechanistic Journey to the Edge of Generalization'☆190Updated 5 months ago
- The source code of our work "Prepacking: A Simple Method for Fast Prefilling and Increased Throughput in Large Language Models" [AISTATS …☆59Updated 7 months ago
- Async pipelined version of Verl☆74Updated last month
- Repository for the paper Stream of Search: Learning to Search in Language☆145Updated 3 months ago
- ☆130Updated last month
- A framework to study AI models in Reasoning, Alignment, and use of Memory (RAM).☆226Updated this week
- A benchmark that challenges language models to code solutions for scientific problems☆117Updated last week
- A simple unified framework for evaluating LLMs☆209Updated 3 weeks ago
- ☆83Updated 3 months ago
- Code for Paper: Learning Adaptive Parallel Reasoning with Language Models☆77Updated 2 weeks ago
- Implementation of the Quiet-STAR paper (https://arxiv.org/pdf/2403.09629.pdf)☆53Updated 9 months ago
- SWE Arena☆33Updated 3 weeks ago
- Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.☆172Updated 2 months ago
- BABILong is a benchmark for LLM evaluation using the needle-in-a-haystack approach.☆200Updated last week
- An Open Math Pre-trainng Dataset with 370B Tokens.☆80Updated last month
- Dynamic Cheatsheet: Test-Time Learning with Adaptive Memory☆56Updated last month