In this work, we investigate the compositionality of large language models (LLMs) in mathematical reasoning. Specifically, we construct a new dataset MATHTRAP‡ by introducing carefully designed logical traps into the problem descriptions of MATH and GSM8K.
☆59Mar 15, 2025Updated last year
Alternatives and similar repositories for MathTrap
Users that are interested in MathTrap are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A curated list of awesome resources about reward construction for AI agents. This repository covers cutting-edge research, and practical …☆61Sep 1, 2025Updated last year
- Code and data for "Living in the Moment: Can Large Language Models Grasp Co-Temporal Reasoning?" (ACL 2024)☆31Jul 3, 2024Updated 2 years ago
- We introduce 'Thinking with Video', a new paradigm leveraging video generation for multimodal reasoning. Our VideoThinkBench shows that S…☆320Aug 23, 2026Updated 3 weeks ago
- Official Implementation of ACL 2021 paper “GeoQA: A Geometric Question Answering Benchmark Towards Multimodal Numerical Reasoning”.☆77Jan 10, 2022Updated 4 years ago
- Exercises Galois theory D. Cox☆13Jun 29, 2023Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- LLM evaluation on 2024 Chinese Gaokao Mathematics — zero-contamination benchmark with dual prompt formats☆21Apr 15, 2026Updated 4 months ago
- Codes for the paper "BAPO: Stabilizing Off-Policy Reinforcement Learning for LLMs via Balanced Policy Optimization with Adaptive Clipping…☆96Jan 29, 2026Updated 7 months ago
- ☆30Dec 27, 2024Updated last year
- ☆42Jun 11, 2025Updated last year
- Math24o: 高中奥林匹克数学竞赛测评集 High School Olympiad Mathematics Chinese Benchmark☆14Mar 27, 2025Updated last year
- Cross-domain word representation learning☆10May 23, 2015Updated 11 years ago
- Elastic Attention: Test-time Adaptive Sparsity Ratios for Efficient Transformers☆24May 26, 2026Updated 3 months ago
- Official repo for "SE-Bench: Benchmarking Self-Evolution with Knowledge Internalization"☆29Mar 24, 2026Updated 5 months ago
- Python3使用TF-Hub进行迁移学习(图片分类)☆16May 8, 2018Updated 8 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- 蚂蚁金融自然语言处理竞赛。☆10Sep 3, 2018Updated 8 years ago
- ☆72Feb 4, 2026Updated 7 months ago
- Explore semantic caching to reduce your OpenAI/LLM API bill☆11Jul 21, 2023Updated 3 years ago
- A Prompt Expander OpenAI-Based.☆14Nov 15, 2023Updated 2 years ago
- CLIP-MoE: Mixture of Experts for CLIP☆58Oct 10, 2024Updated last year
- [EMNLP 2025] Distill Visual Chart Reasoning Ability from LLMs to MLLMs☆61Aug 25, 2025Updated last year
- ☆16Jul 9, 2025Updated last year
- [ICML 2025] M-STAR (Multimodal Self-Evolving TrAining for Reasoning) Project. Diving into Self-Evolving Training for Multimodal Reasoning☆75Jul 13, 2025Updated last year
- Exploring the Limitations of Large Language Models on Multi-Hop Queries☆33Mar 2, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A toolkit for finding and analysing the grammars of emergent languages.☆11Nov 16, 2020Updated 5 years ago
- Pre-trained, Scalable, High-performance Reward Models via Policy Discriminative Learning.☆168Sep 23, 2025Updated 11 months ago
- ModelWrappers.jl is a utility package that makes it easier to work with Model parameters stated as (nested) NamedTuples.☆14Dec 31, 2025Updated 8 months ago
- A list of research resources that I've appreciated.☆12Dec 10, 2019Updated 6 years ago
- [NeurIPS 2024] The official implementation of "Image Copy Detection for Diffusion Models"☆18Oct 1, 2024Updated last year
- Description for MV-MATH☆15Jul 20, 2025Updated last year
- This is a pip package implementing Reinforcement Learning algorithms in non-stationary environments supported by the OpenAI Gym toolkit.☆16Jun 28, 2024Updated 2 years ago
- ☆25Jul 20, 2025Updated last year
- Proxy server for quota, usage monitoring and tracking of OpenAI requests☆16Sep 21, 2023Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- 天池算法比赛《BetterMixture - 大模型数据混合挑战赛》的第一名top1解决方案☆33Jul 7, 2024Updated 2 years ago
- ☆13Aug 9, 2023Updated 3 years ago
- Implementation of the first neural natural logic paper on natural language inference☆10Oct 31, 2022Updated 3 years ago
- Source code and checkpoints for legal pre-trained language models.☆14May 9, 2021Updated 5 years ago
- A Python library for processing and filtering TabLib☆14Aug 24, 2024Updated 2 years ago
- Infecting PE☆25Mar 10, 2014Updated 12 years ago
- [Best Natural Language Processing at TreeHacks] Eddy semantically maps your thoughts into an alluring, explorable map, helping you sail y…☆13Feb 21, 2023Updated 3 years ago