In this work, we investigate the compositionality of large language models (LLMs) in mathematical reasoning. Specifically, we construct a new dataset MATHTRAP‡ by introducing carefully designed logical traps into the problem descriptions of MATH and GSM8K.
☆60Mar 15, 2025Updated last year
Alternatives and similar repositories for MathTrap
Users that are interested in MathTrap are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Game-RL: Synthesizing Multimodal Verifiable Game Data to Boost VLMs' General Reasoning☆155Jun 19, 2026Updated 2 weeks ago
- Official Implementation of ACL 2021 paper “GeoQA: A Geometric Question Answering Benchmark Towards Multimodal Numerical Reasoning”.☆76Jan 10, 2022Updated 4 years ago
- We introduce 'Thinking with Video', a new paradigm leveraging video generation for multimodal reasoning. Our VideoThinkBench shows that S…☆309Jun 21, 2026Updated 2 weeks ago
- A minimal beamer theme for UNC Chapel Hill☆11Sep 4, 2018Updated 7 years ago
- The official repository of the Omni-MATH benchmark.☆94Dec 22, 2024Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆143Jun 24, 2026Updated last week
- 测试 https://huggingface.co/OFA-Sys/gsm8k-rft-llama7b-u13b 的 GSM8K 分数☆15Aug 10, 2023Updated 2 years ago
- ☆30Dec 27, 2024Updated last year
- Math24o: 高中奥林匹克数学竞赛测评集 High School Olympiad Mathematics Chinese Benchmark☆13Mar 27, 2025Updated last year
- A (growing) collection of useful abstractions and implementations for research.☆17Jan 20, 2020Updated 6 years ago
- ☆54Mar 6, 2025Updated last year
- DLL - Various Mod Components☆21Aug 17, 2024Updated last year
- Cross-domain word representation learning☆10May 23, 2015Updated 11 years ago
- [CVPR2025] Extrapolating and Decoupling Image-to-Video Generation Models: Motion Modeling is Easier Than You Think☆24Jul 1, 2025Updated last year
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- Implementation of Differential Learning Rate in Keras☆11Jun 4, 2019Updated 7 years ago
- 蚂蚁金融自然语言处理竞赛。☆10Sep 3, 2018Updated 7 years ago
- From Accuracy to Robustness: A Study of Rule- and Model-based Verifiers in Mathematical Reasoning.☆24Oct 7, 2025Updated 8 months ago
- ☆11Apr 29, 2019Updated 7 years ago
- An Ultra-Long Output Reinforcement Learning Approach☆23Jul 31, 2025Updated 11 months ago
- [ICML 2025] M-STAR (Multimodal Self-Evolving TrAining for Reasoning) Project. Diving into Self-Evolving Training for Multimodal Reasoning☆75Jul 13, 2025Updated 11 months ago
- Akcio is a demonstration project for Retrieval Augmented Generation (RAG). It leverages the power of LLM to generate responses and uses v…☆12Oct 30, 2023Updated 2 years ago
- Hierarchical Attention Network based Explainable Knowledge Tracing☆10May 18, 2022Updated 4 years ago
- A collection of research papers related to Natural Language Reasoning☆10May 27, 2022Updated 4 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Copyright-free Artificial Lyrics Dataset (ISMIR 2024 LBD)☆12Sep 1, 2024Updated last year
- Analyzing Latent Concept in Pre-trained Transformer Models☆12Jul 18, 2022Updated 3 years ago
- O1 Replication Journey☆2,001Jan 14, 2025Updated last year
- Gahing 的个人博客，欢迎 star ✨☆14Apr 7, 2026Updated 2 months ago
- [ICLR 25 Spotlight] A testbed for agents and environments that can automatically improve models through data generation.☆28Mar 4, 2025Updated last year
- AI town https://github.com/a16z-infra/ai-town Patches to run on Hugging Face Spaces☆22Jun 6, 2024Updated 2 years ago
- A list of research resources that I've appreciated.☆12Dec 10, 2019Updated 6 years ago
- ☆18Jan 26, 2026Updated 5 months ago
- Source code and checkpoints for legal pre-trained language models.☆14May 9, 2021Updated 5 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- The open source implementation of "Connecting Large Language Models with Evolutionary Algorithms Yields Powerful Prompt Optimizers"☆19Mar 11, 2024Updated 2 years ago
- [ACL' 25] The official code repository for PRMBench: A Fine-grained and Challenging Benchmark for Process-Level Reward Models.☆92Feb 15, 2025Updated last year
- ☆10Nov 6, 2021Updated 4 years ago
- ☆62Mar 2, 2026Updated 4 months ago
- ATEC 蚂蚁金服 交易风险预测 Final_score:0.7494☆12Oct 19, 2018Updated 7 years ago
- ☆17Oct 15, 2023Updated 2 years ago
- Code and data for "ConflictBank: A Benchmark for Evaluating the Influence of Knowledge Conflicts in LLM" (NeurIPS 2024 Track Datasets and…☆70May 16, 2025Updated last year