Alternatives and similar repositories for BatchEval

Users that are interested in BatchEval are comparing it to the libraries listed below

• rookie-joe / AutoPSV
  ☆50Updated last year
• SihengLi99 / LLM-Honesty-Survey
  [2025-TMLR] A Survey on the Honesty of Large Language Models
  ☆62Updated 11 months ago
• OpenMOSS / Say-I-Dont-Know
  [ICML'2024] Can AI Assistants Know What They Don't Know?
  ☆83Updated last year
• RUCAIBox / RLMEC
  The official repository of "Improving Large Language Models via Fine-grained Reinforcement Learning with Minimum Editing Constraint"
  ☆38Updated last year
• SparkJiao / dpo-trajectory-reasoning
  [EMNLP 2024] Source code for the paper "Learning Planning-based Reasoning with Trajectory Collection and Process Rewards Synthesizing".
  ☆82Updated 10 months ago
• WangHanLinHenry / SPA-RL-Agent
  Official code for paper "SPA-RL: Reinforcing LLM Agent via Stepwise Progress Attribution"
  ☆49Updated 2 months ago
• WeiminXiong / IPR
  Watch Every Step! LLM Agent Learning via Iterative Step-level Process Refinement (EMNLP 2024 Main Conference)
  ☆63Updated last year
• RUCAIBox / HaluEval-2.0
  ☆47Updated last year
• JoeYing1019 / UltraTool
  [ACL2024] Planning, Creation, Usage: Benchmarking LLMs for Comprehensive Tool Utilization in Real-World Complex Scenarios
  ☆66Updated 3 months ago
• GAIR-NLP / alignment-for-honesty
  ☆76Updated last year
• Vance0124 / Token-level-Direct-Preference-Optimization
  Reference implementation for Token-level Direct Preference Optimization(TDPO)
  ☆149Updated 9 months ago
• iwangjian / Midi-Tuning
  Instruct Once, Chat Consistently in Multiple Rounds: An Efficient Tuning Framework for Dialogue (ACL 2024)
  ☆24Updated last month
• BenfengXu / KNNPrompting
  Released code for our ICLR23 paper.
  ☆66Updated 2 years ago
• ValueCompass / Alignment-Goal-Survey
  ☆30Updated last year
• PKU-Alignment / aligner
  [NeurIPS 2024 Oral] Aligner: Efficient Alignment by Learning to Correct
  ☆190Updated 10 months ago
• YiCheng98 / IntegrativeDecoding
  Official Implementation for the paper "Integrative Decoding: Improving Factuality via Implicit Self-consistency"
  ☆32Updated 7 months ago
• pldlgb / nuggets
  ☆86Updated last year
• TianHongZXY / CoRe
  [ACL 2023] Solving Math Word Problems via Cooperative Reasoning induced Language Models (LLMs + MCTS + Self-Improvement)
  ☆49Updated last year
• tengxiaoliu / XoT
  [EMNLP 2023] Plan, Verify and Switch: Integrated Reasoning with Diverse X-of-Thoughts
  ☆28Updated 2 years ago
• yinzhangyue / SelfAware
  Do Large Language Models Know What They Don’t Know?
  ☆101Updated last year
• THUNLP-MT / SKR
  Self-Knowledge Guided Retrieval Augmentation for Large Language Models (EMNLP Findings 2023)
  ☆28Updated last year
• JetRunner / SuperICL
  Code for "Small Models are Valuable Plug-ins for Large Language Models"
  ☆131Updated 2 years ago
• WooooDyy / MathCritique
  Implementation for the research paper "Enhancing LLM Reasoning via Critique Models with Test-Time and Training-Time Supervision".
  ☆56Updated 11 months ago
• pillowsofwind / Knowledge-Conflicts-Survey
  [EMNLP 2024] The official GitHub repo for the survey paper "Knowledge Conflicts for LLMs: A Survey"
  ☆145Updated last year
• Zhou-Zoey / RMB-Reward-Model-Benchmark
  ☆45Updated 7 months ago
• wangpf3 / consistent-CoT-distillation
  ☆43Updated 2 years ago
• THU-KEG / RM-Bench
  [ICLR 25 Oral] RM-Bench: Benchmarking Reward Models of Language Models with Subtlety and Style
  ☆67Updated 4 months ago
• ShujinWu-0814 / ALOE
  Public code repo for COLING 2025 paper "Aligning LLMs with Individual Preferences via Interaction"
  ☆38Updated 7 months ago
• FreedomIntelligence / OVM
  ☆69Updated last year
• wzhouad / WPO
  Code and models for EMNLP 2024 paper "WPO: Enhancing RLHF with Weighted Preference Optimization"
  ☆41Updated last year