In this work, we investigate the compositionality of large language models (LLMs) in mathematical reasoning. Specifically, we construct a new dataset MATHTRAP‡ by introducing carefully designed logical traps into the problem descriptions of MATH and GSM8K.
☆59Mar 15, 2025Updated last year
Alternatives and similar repositories for MathTrap
Users that are interested in MathTrap are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A curated list of awesome resources about reward construction for AI agents. This repository covers cutting-edge research, and practical …☆61Sep 1, 2025Updated last year
- Computer Graphics Course (COMP130018.01, 2023 Spring) Project of Fudan University.☆14Aug 4, 2023Updated 3 years ago
- Code and data for "Timo: Towards Better Temporal Reasoning for Language Models" (COLM 2024)☆26Oct 23, 2024Updated last year
- ☆54Feb 12, 2025Updated last year
- Code and data for "Living in the Moment: Can Large Language Models Grasp Co-Temporal Reasoning?" (ACL 2024)☆31Jul 3, 2024Updated 2 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- [AAAI 2024] LLMEval Phase II dataset — professional domain evaluation across 12 academic disciplines☆71May 21, 2026Updated 4 months ago
- ☆23May 23, 2025Updated last year
- We introduce 'Thinking with Video', a new paradigm leveraging video generation for multimodal reasoning. Our VideoThinkBench shows that S…☆319Aug 23, 2026Updated last month
- A minimal beamer theme for UNC Chapel Hill☆11Sep 4, 2018Updated 8 years ago
- Implementation of the ICML 2024 paper "Training Large Language Models for Reasoning through Reverse Curriculum Reinforcement Learning" pr…☆117Feb 9, 2024Updated 2 years ago
- Exercises Galois theory D. Cox☆13Jun 29, 2023Updated 3 years ago
- The official repository of the Omni-MATH benchmark.☆92Dec 22, 2024Updated last year
- Codes for the paper "BAPO: Stabilizing Off-Policy Reinforcement Learning for LLMs via Balanced Policy Optimization with Adaptive Clipping…☆96Jan 29, 2026Updated 8 months ago
- ☆43Jun 11, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A (growing) collection of useful abstractions and implementations for research.☆17Jan 20, 2020Updated 6 years ago
- ☆54Mar 6, 2025Updated last year
- [ACL 2024]Official GitHub repo for OlympiadBench: A Challenging Benchmark for Promoting AGI with Olympiad-Level Bilingual Multimodal Scie…☆199Jun 8, 2025Updated last year
- Cross-domain word representation learning☆10May 23, 2015Updated 11 years ago
- [CVPR 2025] Adaptive Markup Language Generation for Contextually-Grounded Visual Document Understanding☆17Jun 16, 2025Updated last year
- Elastic Attention: Test-time Adaptive Sparsity Ratios for Efficient Transformers☆24May 26, 2026Updated 4 months ago
- ☆16Jun 4, 2024Updated 2 years ago
- ☆19Jun 26, 2024Updated 2 years ago
- Explore semantic caching to reduce your OpenAI/LLM API bill☆11Jul 21, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆11Jul 21, 2024Updated 2 years ago
- ☆11Apr 29, 2019Updated 7 years ago
- Grade-School Math with Irrelevant Context (GSM-IC) benchmark is an arithmetic reasoning dataset built upon GSM8K, by adding irrelevant se…☆67Feb 13, 2023Updated 3 years ago
- CLIP-MoE: Mixture of Experts for CLIP☆57Oct 10, 2024Updated last year
- The fastest Tropical number matrix multiplication on GPU☆12Sep 8, 2026Updated 3 weeks ago
- [EMNLP 2025] Distill Visual Chart Reasoning Ability from LLMs to MLLMs☆62Aug 25, 2025Updated last year
- Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax☆16Jun 16, 2024Updated 2 years ago
- Detect nearby AirTags in disconnected or lost modes.☆10Feb 3, 2022Updated 4 years ago
- ☆16Jul 9, 2025Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Digital image analysis using discrete Morse theory and persistent homology☆30Nov 9, 2025Updated 10 months ago
- ☆11Oct 17, 2024Updated last year
- Exploring the Limitations of Large Language Models on Multi-Hop Queries☆33Mar 2, 2025Updated last year
- Code for CVPR 2024 paper: Positive-Unlabeled Learning by Latent Group-Aware Meta Disambiguation☆22May 19, 2024Updated 2 years ago
- ☆10Dec 12, 2023Updated 2 years ago
- ☆12Jan 31, 2024Updated 2 years ago
- ModelWrappers.jl is a utility package that makes it easier to work with Model parameters stated as (nested) NamedTuples.☆14Dec 31, 2025Updated 9 months ago