Alternatives and similar repositories for MARIO_EVAL

Users that are interested in MARIO_EVAL are comparing it to the libraries listed below

• QwenLM / ProcessBench
  Official repository for ACL 2025 paper "ProcessBench: Identifying Process Errors in Mathematical Reasoning"
  ☆182Updated 7 months ago
• icip-cas / awesome-auto-alignment
  Collection of papers for scalable automated alignment.
  ☆93Updated last year
• YJiangcm / FollowBench
  [ACL 2024] FollowBench: A Multi-level Fine-grained Constraints Following Benchmark for Large Language Models
  ☆119Updated 7 months ago
• MARIO-Math-Reasoning / Super_MARIO
  ☆340Updated 7 months ago
• FreedomIntelligence / OVM
  ☆71Updated last year
• xingyaoww / mint-bench
  Official Repo for ICLR 2024 paper MINT: Evaluating LLMs in Multi-turn Interaction with Tools and Language Feedback by Xingyao Wang*, Ziha…
  ☆132Updated last year
• OFA-Sys / gsm8k-ScRel
  Codes and Data for Scaling Relationship on Learning Mathematical Reasoning with Large Language Models
  ☆269Updated last year
• multimodal-art-projection / KORGym
  ☆53Updated 7 months ago
• LLaMafia / SFT_function_learning
  Explore what LLMs are really leanring over SFT
  ☆28Updated last year
• SparkJiao / dpo-trajectory-reasoning
  [EMNLP 2024] Source code for the paper "Learning Planning-based Reasoning with Trajectory Collection and Process Rewards Synthesizing".
  ☆83Updated last year
• GAIR-NLP / ReasonEval
  [AAAI 2025 oral] Evaluating Mathematical Reasoning Beyond Accuracy
  ☆76Updated 3 months ago
• YuxiXie / MCTS-DPO
  This is the repository that contains the source code for the Self-Evaluation Guided MCTS for online DPO.
  ☆328Updated last year
• princeton-nlp / QuRating
  [ICML 2024] Selecting High-Quality Data for Training Language Models
  ☆199Updated last month
• GAIR-NLP / alignment-for-honesty
  ☆77Updated last year
• thu-coai / ComplexBench
  Benchmarking Complex Instruction-Following with Multiple Constraints Composition (NeurIPS 2024 Datasets and Benchmarks Track)
  ☆99Updated 10 months ago
• princeton-nlp / LLMBar
  [ICLR 2024] Evaluating Large Language Models at Evaluating Instruction Following
  ☆134Updated last year
• qtli / GSM-Plus
  GSM-Plus: Data, Code, and Evaluation for Enhancing Robust Mathematical Reasoning in Math Word Problems.
  ☆64Updated last year
• THUNLP-MT / StableToolBench
  A new tool learning benchmark aiming at well-balanced stability and reality, based on ToolBench.
  ☆206Updated 9 months ago
• mtbench101 / mt-bench-101
  [ACL 2024] MT-Bench-101: A Fine-Grained Benchmark for Evaluating Large Language Models in Multi-Turn Dialogues
  ☆136Updated last year
• fanqiwan / Explore-Instruct
  EMNLP'2023: Explore-Instruct: Enhancing Domain-Specific Instruction Coverage through Active Exploration
  ☆36Updated last year
• ZubinGou / math-evaluation-harness
  A simple toolkit for benchmarking LLMs on mathematical reasoning tasks. 🧮✨
  ☆271Updated last year
• Zhou-Zoey / RMB-Reward-Model-Benchmark
  ☆47Updated 9 months ago
• PKU-Baichuan-MLSystemLab / CFBench
  CFBench: A Comprehensive Constraints-Following Benchmark for LLMs
  ☆46Updated last year
• lancopku / label-words-are-anchors
  Repository for Label Words are Anchors: An Information Flow Perspective for Understanding In-Context Learning
  ☆168Updated last year
• allenai / FineGrainedRLHF
  ☆281Updated last year
• OpenBMB / UltraFeedback
  A large-scale, fine-grained, diverse preference dataset (and models).
  ☆360Updated 2 years ago
• sail-sg / regmix
  [ICLR 2025] 🧬 RegMix: Data Mixture as Regression for Language Model Pre-training (Spotlight)
  ☆181Updated 11 months ago
• princeton-nlp / CEPE
  [ACL 2024] Long-Context Language Modeling with Parallel Encodings
  ☆168Updated last year
• qinyiwei / InfoBench
  ☆58Updated last year
• hanningzhang / ER-PRM
  ☆20Updated last year