tongjingqi / MathTrapLinks
In this work, we investigate the compositionality of large language models (LLMs) in mathematical reasoning. Specifically, we construct a new dataset MATHTRAP‡ by introducing carefully designed logical traps into the problem descriptions of MATH and GSM8K.
☆61Updated 7 months ago
Alternatives and similar repositories for MathTrap
Users that are interested in MathTrap are comparing it to the libraries listed below
Sorting:
- A simple toolkit for benchmarking LLMs on mathematical reasoning tasks. 🧮✨☆258Updated last year
- Generative AI Act II: Test Time Scaling Drives Cognition Engineering☆207Updated 5 months ago
- A Framework for LLM-based Multi-Agent Reinforced Training and Inference☆301Updated last week
- A version of verl to support diverse tool use☆607Updated this week
- Official code for the paper, "Stop Summation: Min-Form Credit Assignment Is All Process Reward Model Needs for Reasoning"☆137Updated 3 months ago
- Awesome-Long2short-on-LRMs is a collection of state-of-the-art, novel, exciting long2short methods on large reasoning models. It contains…☆247Updated 2 months ago
- Official Repository of "Learning to Reason under Off-Policy Guidance"☆340Updated 2 weeks ago
- xVerify: Efficient Answer Verifier for Reasoning Model Evaluations☆133Updated 6 months ago
- 😎 A Survey of Efficient Reasoning for Large Reasoning Models: Language, Multimodality, Agent, and Beyond☆306Updated 2 weeks ago
- ☆211Updated 7 months ago
- ☆342Updated 4 months ago
- Curation of resources for LLM mathematical reasoning, most of which are screened by @tongyx361 to ensure high quality and accompanied wit…☆143Updated last year
- ☆297Updated 4 months ago
- The Entropy Mechanism of Reinforcement Learning for Large Language Model Reasoning.☆345Updated 3 months ago
- a survey of long-context LLMs from four perspectives, architecture, infrastructure, training, and evaluation☆58Updated 6 months ago
- Chain of Thoughts (CoT) is so hot! so long! We need short reasoning process!☆69Updated 6 months ago
- Implementation for the research paper "Enhancing LLM Reasoning via Critique Models with Test-Time and Training-Time Supervision".☆56Updated 10 months ago
- A series of technical report on Slow Thinking with LLM☆739Updated 2 months ago
- ☆208Updated 6 months ago
- A comprehensive collection of process reward models.☆111Updated 2 weeks ago
- ☆321Updated 4 months ago
- L1: Controlling How Long A Reasoning Model Thinks With Reinforcement Learning☆258Updated 5 months ago
- ReST-MCTS*: LLM Self-Training via Process Reward Guided Tree Search (NeurIPS 2024)☆671Updated 8 months ago
- A lightweight reproduction of DeepSeek-R1-Zero with indepth analysis of self-reflection behavior.☆247Updated 6 months ago
- Trinity-RFT is a general-purpose, flexible and scalable framework designed for reinforcement fine-tuning (RFT) of large language models (…☆366Updated this week
- ☆214Updated 2 months ago
- This is the repository that contains the source code for the Self-Evaluation Guided MCTS for online DPO.☆327Updated last year
- A versatile toolkit for applying Logit Lens to modern large language models (LLMs). Currently supports Llama-3.1-8B and Qwen-2.5-7B, enab…☆117Updated 2 months ago
- This is the repository of DEER, a Dynamic Early Exit in Reasoning method for Large Reasoning Language Models.☆170Updated 3 months ago
- This repository contains a regularly updated paper list for LLMs-reasoning-in-latent-space.☆170Updated last week