MathEval is a benchmark dedicated to the holistic evaluation on mathematical capacities of LLMs.
☆87Nov 15, 2024Updated last year
Alternatives and similar repositories for MathEval
Users that are interested in MathEval are comparing it to the libraries listed below
Sorting:
- [ACL 2024 Findings] MathBench: A Comprehensive Multi-Level Difficulty Mathematics Evaluation Dataset☆112May 22, 2025Updated 9 months ago
- AAAI2024 Global Competition on Math Problem Solving and Reasoning☆14Oct 4, 2023Updated 2 years ago
- The source code for "Recommender Systems with Heterogeneous Side Information", WWW 2019.☆28Feb 19, 2020Updated 6 years ago
- The official repository of the Omni-MATH benchmark.☆93Dec 22, 2024Updated last year
- A simple toolkit for benchmarking LLMs on mathematical reasoning tasks. 🧮✨☆273Apr 26, 2024Updated last year
- A GPT-based generative LM for combined text and math formulas, leveraging tree-based formula encoding. Published as "Tree-Based Represent…☆41Jul 16, 2023Updated 2 years ago
- PULSE-EVAL☆24Jan 12, 2024Updated 2 years ago
- Mix of Minimal Optimal Sets (MMOS) of dataset has two advantages for two aspects, higher performance and lower construction costs on math…☆74Jul 27, 2024Updated last year
- [NeurIPS 2024] OlympicArena: Benchmarking Multi-discipline Cognitive Reasoning for Superintelligent AI☆107Mar 6, 2025Updated last year
- ☆30Dec 27, 2024Updated last year
- Code for the ACL2022 paper "Synthetic Question Value Estimation for Domain Adaptation of Question Answering"☆17Mar 21, 2022Updated 3 years ago
- 好未来开源教育领域首个在线教学中文预训练模型TAL-EduBERT☆197Jan 26, 2021Updated 5 years ago
- A Manually-Annotated Code Generation Benchmark Aligned with Real-World Code Repositories☆36Sep 4, 2024Updated last year
- TSQA: Tabular Scenario Based Question Answering (AAAI 2021)☆18Dec 17, 2020Updated 5 years ago
- ☆13May 12, 2025Updated 10 months ago
- 爬取同花顺的股票（A股）信息☆10Nov 5, 2021Updated 4 years ago
- An Experiment on Dynamic NTK Scaling RoPE☆64Nov 26, 2023Updated 2 years ago
- ☆19Jul 31, 2025Updated 7 months ago
- The dataset and code for paper: TheoremQA: A Theorem-driven Question Answering dataset☆160Apr 23, 2024Updated last year
- ☆10Dec 28, 2023Updated 2 years ago
- [AAAI 2025] Augmenting Math Word Problems via Iterative Question Composing (https://arxiv.org/abs/2401.09003)☆23Oct 2, 2025Updated 5 months ago
- Graph4Tree is a simple example code for our EMNLP'20 Findings paper idea.☆26Nov 18, 2020Updated 5 years ago
- A pytorch implement of "Application of Deep Self-Attention in Knowledge Tracing"☆10May 21, 2021Updated 4 years ago
- Self-Evolved Diverse Data Sampling for Efficient Instruction Tuning☆86Dec 14, 2023Updated 2 years ago
- pyKT: A Python Library to Benchmark Deep Learning based Knowledge Tracing Models☆360Jan 13, 2026Updated 2 months ago
- GSM-Plus: Data, Code, and Evaluation for Enhancing Robust Mathematical Reasoning in Math Word Problems.☆64Jul 8, 2024Updated last year
- [ACL 2024 Demo] Official GitHub repo for UltraEval: An open source framework for evaluating foundation models.☆256Oct 30, 2024Updated last year
- Code for the paper "Code-Mixing on Sesame Street: Dawn of the Adversarial Polyglots" (NAACL-HLT 2021)☆10May 1, 2025Updated 10 months ago
- the instructions and demonstrations for building a formal logical reasoning capable GLM☆54Sep 3, 2024Updated last year
- Path to Medical AGI: Unify Domain-specific Medical LLMs with the Lowest Cost☆39Jun 21, 2023Updated 2 years ago
- [ICML'24] TroVE: Inducing Verifiable and Efficient Toolboxes for Solving Programmatic Tasks☆32Sep 20, 2024Updated last year
- ☆26Nov 1, 2021Updated 4 years ago
- Source code of Venus-MAXWELL: Efficient Learning of Protein-Mutation Stability Landscapes using Protein Language Models☆23Jun 3, 2025Updated 9 months ago
- Technical Report: Is ChatGPT a Good NLG Evaluator? A Preliminary Study☆43Mar 8, 2023Updated 3 years ago
- An AI regulatory assistant to pre-check your documentation before FDA or MDR submission.☆13Jul 31, 2024Updated last year
- [NAACL 2025] Representing Rule-based Chatbots with Transformers☆23Feb 9, 2025Updated last year
- A custom line wrap layout ,support set max lines.(自定义流式布局，支持设置最大行数)☆11Apr 13, 2018Updated 7 years ago
- ☆15Feb 27, 2026Updated 2 weeks ago
- [MathCoder, MathCoder-VL] Family of LLMs/LMMs for mathematical reasoning.☆336Oct 18, 2025Updated 5 months ago