Alternatives and similar repositories for BatchEval

Users that are interested in BatchEval are comparing it to the libraries listed below

• SihengLi99 / LLM-Honesty-Survey
  [2025-TMLR] A Survey on the Honesty of Large Language Models
  ☆63Updated last year
• OpenMOSS / Say-I-Dont-Know
  [ICML'2024] Can AI Assistants Know What They Don't Know?
  ☆85Updated last year
• JoeYing1019 / UltraTool
  [ACL2024] Planning, Creation, Usage: Benchmarking LLMs for Comprehensive Tool Utilization in Real-World Complex Scenarios
  ☆66Updated 4 months ago
• RUCAIBox / HaluEval-2.0
  ☆48Updated last year
• rookie-joe / AutoPSV
  ☆51Updated last year
• RUCAIBox / RLMEC
  The official repository of "Improving Large Language Models via Fine-grained Reinforcement Learning with Minimum Editing Constraint"
  ☆38Updated last year
• zchuz / TimeBench
  The repository for ACL 2024 paper "TimeBench: A Comprehensive Evaluation of Temporal Reasoning Abilities in Large Language Models"
  ☆32Updated last year
• tengxiaoliu / XoT
  [EMNLP 2023] Plan, Verify and Switch: Integrated Reasoning with Diverse X-of-Thoughts
  ☆28Updated 2 years ago
• YiCheng98 / IntegrativeDecoding
  Official Implementation for the paper "Integrative Decoding: Improving Factuality via Implicit Self-consistency"
  ☆32Updated 8 months ago
• Vance0124 / Token-level-Direct-Preference-Optimization
  Reference implementation for Token-level Direct Preference Optimization(TDPO)
  ☆149Updated 10 months ago
• WeiminXiong / IPR
  Watch Every Step! LLM Agent Learning via Iterative Step-level Process Refinement (EMNLP 2024 Main Conference)
  ☆64Updated last year
• SparkJiao / dpo-trajectory-reasoning
  [EMNLP 2024] Source code for the paper "Learning Planning-based Reasoning with Trajectory Collection and Process Rewards Synthesizing".
  ☆83Updated 11 months ago
• JetRunner / SuperICL
  Code for "Small Models are Valuable Plug-ins for Large Language Models"
  ☆132Updated 2 years ago
• sanowl / Self-Correcting-LLM--Reinforcement-Learning-
  This my attempt to create Self-Correcting-LLM based on the paper Training Language Models to Self-Correct via Reinforcement Learning by g…
  ☆37Updated 5 months ago
• ShujinWu-0814 / ALOE
  Public code repo for COLING 2025 paper "Aligning LLMs with Individual Preferences via Interaction"
  ☆40Updated 8 months ago
• BenfengXu / KNNPrompting
  Released code for our ICLR23 paper.
  ☆66Updated 2 years ago
• lancopku / label-words-are-anchors
  Repository for Label Words are Anchors: An Information Flow Perspective for Understanding In-Context Learning
  ☆168Updated last year
• FreedomIntelligence / OVM
  ☆70Updated last year
• ValueCompass / Alignment-Goal-Survey
  ☆30Updated last year
• open-compass / ANAH
  [ACL 2024] ANAH & [NeurIPS 2024] ANAH-v2 & [ICLR 2025] Mask-DPO
  ☆60Updated 7 months ago
• GAIR-NLP / alignment-for-honesty
  ☆76Updated last year
• Arvid-pku / ALCUNA
  [EMNLP 2023] ALCUNA: Large Language Models Meet New Knowledge
  ☆28Updated 2 years ago
• PKU-Alignment / aligner
  [NeurIPS 2024 Oral] Aligner: Efficient Alignment by Learning to Correct
  ☆192Updated 11 months ago
• OrangeInSouth / DeePEn
  A method of ensemble learning for heterogeneous large language models.
  ☆64Updated last year
• Junjie-Ye / ToolEyes
  [COLING 2025] ToolEyes: Fine-Grained Evaluation for Tool Learning Capabilities of Large Language Models in Real-world Scenarios
  ☆71Updated 7 months ago
• iwangjian / Midi-Tuning
  Instruct Once, Chat Consistently in Multiple Rounds: An Efficient Tuning Framework for Dialogue (ACL 2024)
  ☆24Updated 2 months ago
• DAMO-NLP-SG / Auto-Arena-LLMs
  ☆42Updated last year
• THU-KEG / RM-Bench
  [ICLR 25 Oral] RM-Bench: Benchmarking Reward Models of Language Models with Subtlety and Style
  ☆72Updated 5 months ago
• halfrot / ALaRM
  [ACL 2024] Code for the paper "ALaRM: Align Language Models via Hierarchical Rewards Modeling"
  ☆25Updated last year
• Yifan-Song793 / ETO
  Trial and Error: Exploration-Based Trajectory Optimization of LLM Agents (ACL 2024 Main Conference)
  ☆159Updated last year