math-eval / MathEval
MathEval is a benchmark dedicated to the holistic evaluation on mathematical capacities of LLMs.
☆73Updated 3 months ago
Alternatives and similar repositories for MathEval:
Users that are interested in MathEval are comparing it to the libraries listed below
- Code and data for the paper "Can Large Language Models Understand Real-World Complex Instructions?"(AAAI2024)☆47Updated 10 months ago
- Unofficial implementation of AlpaGasus☆90Updated last year
- Benchmarking Complex Instruction-Following with Multiple Constraints Composition (NeurIPS 2024 Datasets and Benchmarks Track)☆64Updated this week
- ☆139Updated 7 months ago
- [COLING 2025] ToolEyes: Fine-Grained Evaluation for Tool Learning Capabilities of Large Language Models in Real-world Scenarios☆65Updated 2 months ago
- ☆96Updated 11 months ago
- ☆94Updated last year
- ☆130Updated 10 months ago
- [EMNLP 2023 Demo] CLEVA: Chinese Language Models EVAluation Platform☆61Updated last year
- Official implementation of the paper "From Complex to Simple: Enhancing Multi-Constraint Complex Instruction Following Ability of Large L…☆44Updated 7 months ago
- MEASURING MASSIVE MULTITASK CHINESE UNDERSTANDING☆88Updated 10 months ago
- ☆26Updated 9 months ago
- Logiqa2.0 dataset - logical reasoning in MRC and NLI tasks☆86Updated last year
- 本项目用于大模型数学解题能力方面的数据集合成,模型训练及评测,相关文章记录。☆73Updated 5 months ago
- 中文大语言模型评测第二期☆70Updated last year
- [ICLR'24 spotlight] Tool-Augmented Reward Modeling☆44Updated last month
- ☆81Updated 10 months ago
- A Massive Multi-Level Multi-Subject Knowledge Evaluation benchmark☆100Updated last year
- Unleashing the Power of Cognitive Dynamics on Large Language Models☆60Updated 4 months ago
- The official repository of the Omni-MATH benchmark.☆71Updated 2 months ago
- [ACL 2024 Findings] MathBench: A Comprehensive Multi-Level Difficulty Mathematics Evaluation Dataset☆95Updated 7 months ago
- A Bilingual Role Evaluation Benchmark for Large Language Models☆38Updated last year
- Fantastic Data Engineering for Large Language Models☆71Updated last month
- repository for CharacterChat, a personalized social support system☆66Updated 7 months ago
- [ACL'24] Superfiltering: Weak-to-Strong Data Filtering for Fast Instruction-Tuning☆142Updated 5 months ago
- [EMNLP 2024] A Multi-level Hallucination Diagnostic Benchmark for Tool-Augmented Large Language Models.☆16Updated 4 months ago
- EMNLP'2024: Knowledge Verification to Nip Hallucination in the Bud☆22Updated 11 months ago
- ☆80Updated last year
- SuperCLUE-Math6:新一代中文原生多轮多步数学推理数据集的探索之旅☆53Updated last year
- The implementation of paper "LLM Critics Help Catch Bugs in Mathematics: Towards a Better Mathematical Verifier with Natural Language Fee…☆38Updated 6 months ago