Alternatives and similar repositories for MT-Eval:

Users that are interested in MT-Eval are comparing it to the libraries listed below

• shizhediao / R-Tuning
  [NAACL 2024 Outstanding Paper] Source code for the NAACL 2024 paper entitled "R-Tuning: Instructing Large Language Models to Say 'I Don't…
  ☆110Updated 9 months ago
• halfrot / ALaRM
  [ACL 2024] Code for the paper "ALaRM: Align Language Models via Hierarchical Rewards Modeling"
  ☆25Updated last year
• SparkJiao / dpo-trajectory-reasoning
  [EMNLP 2024] Source code for the paper "Learning Planning-based Reasoning with Trajectory Collection and Process Rewards Synthesizing".
  ☆76Updated 3 months ago
• FreedomIntelligence / OVM
  ☆66Updated last year
• MiuLab / PersonaLLM-Survey
  ☆86Updated 6 months ago
• SuperBruceJia / Awesome-LLM-Self-Consistency
  Awesome LLM Self-Consistency: a curated list of Self-consistency in Large Language Models
  ☆96Updated 8 months ago
• chujiezheng / LLM-Extrapolation
  Official repository for paper "Weak-to-Strong Extrapolation Expedites Alignment"
  ☆74Updated 10 months ago
• mtbench101 / mt-bench-101
  [ACL 2024] MT-Bench-101: A Fine-Grained Benchmark for Evaluating Large Language Models in Multi-Turn Dialogues
  ☆85Updated 9 months ago
• icip-cas / awesome-auto-alignment
  Collection of papers for scalable automated alignment.
  ☆89Updated 6 months ago
• Junjie-Ye / ToolEyes
  [COLING 2025] ToolEyes: Fine-Grained Evaluation for Tool Learning Capabilities of Large Language Models in Real-world Scenarios
  ☆65Updated 5 months ago
• qinyiwei / InfoBench
  ☆53Updated 8 months ago
• RUCAIBox / HaluEval-2.0
  ☆41Updated last year
• xlang-ai / BRIGHT
  BRIGHT: A Realistic and Challenging Benchmark for Reasoning-Intensive Retrieval
  ☆107Updated 2 weeks ago
• WeiminXiong / IPR
  Watch Every Step! LLM Agent Learning via Iterative Step-level Process Refinement (EMNLP 2024 Main Conference)
  ☆57Updated 6 months ago
• pillowsofwind / Knowledge-Conflicts-Survey
  [EMNLP 2024] The official GitHub repo for the survey paper "Knowledge Conflicts for LLMs: A Survey"
  ☆114Updated 7 months ago
• oriyor / ret-robust
  Implementation of the paper: "Making Retrieval-Augmented Language Models Robust to Irrelevant Context"
  ☆70Updated 9 months ago
• xingyaoww / mint-bench
  Official Repo for ICLR 2024 paper MINT: Evaluating LLMs in Multi-turn Interaction with Tools and Language Feedback by Xingyao Wang*, Ziha…
  ☆123Updated 11 months ago
• GAIR-NLP / ReasonEval
  [AAAI 2025 oral] Evaluating Mathematical Reasoning Beyond Accuracy
  ☆60Updated 4 months ago
• GAIR-NLP / alignment-for-honesty
  ☆73Updated 11 months ago
• meowpass / FollowComplexInstruction
  Official implementation of the paper "From Complex to Simple: Enhancing Multi-Constraint Complex Instruction Following Ability of Large L…
  ☆48Updated 10 months ago
• qtli / GSM-Plus
  GSM-Plus: Data, Code, and Evaluation for Enhancing Robust Mathematical Reasoning in Math Word Problems.
  ☆60Updated 9 months ago
• ChengpengLi1003 / DotaMath
  ☆29Updated 4 months ago
• OpenLMLab / LongWanjuan
  Towards Systematic Measurement for Long Text Quality
  ☆34Updated 8 months ago
• RUCAIBox / RLMEC
  The official repository of "Improving Large Language Models via Fine-grained Reinforcement Learning with Minimum Editing Constraint"
  ☆38Updated last year
• OSU-NLP-Group / llm-planning-eval
  [ACL'24] Code and data of paper "When is Tree Search Useful for LLM Planning? It Depends on the Discriminator"
  ☆54Updated last year
• THUNLP-MT / SKR
  Self-Knowledge Guided Retrieval Augmentation for Large Language Models (EMNLP Findings 2023)
  ☆26Updated last year
• tengxiaoliu / XoT
  [EMNLP 2023] Plan, Verify and Switch: Integrated Reasoning with Diverse X-of-Thoughts
  ☆27Updated last year
• THU-KEG / RM-Bench
  [ICLR 25 Oral] RM-Bench: Benchmarking Reward Models of Language Models with Subtlety and Style
  ☆34Updated last month
• thu-coai / ComplexBench
  Benchmarking Complex Instruction-Following with Multiple Constraints Composition (NeurIPS 2024 Datasets and Benchmarks Track)
  ☆81Updated 2 months ago
• princeton-nlp / LLMBar
  [ICLR 2024] Evaluating Large Language Models at Evaluating Instruction Following
  ☆124Updated 9 months ago