Alternatives and similar repositories for Auto-Arena-LLMs

Users that are interested in Auto-Arena-LLMs are comparing it to the libraries listed below

• dvlab-research / Mr-Ben
  This is the repo for our paper "Mr-Ben: A Comprehensive Meta-Reasoning Benchmark for Large Language Models"
  ☆50Updated 10 months ago
• ZHZisZZ / weak-to-strong-search
  [NeurIPS'24] Weak-to-Strong Search: Align Large Language Models via Searching over Small Language Models
  ☆62Updated 9 months ago
• GAIR-NLP / ReasonEval
  [AAAI 2025 oral] Evaluating Mathematical Reasoning Beyond Accuracy
  ☆69Updated 9 months ago
• SihengLi99 / LLM-Honesty-Survey
  [2025-TMLR] A Survey on the Honesty of Large Language Models
  ☆59Updated 9 months ago
• xufangzhi / ENVISIONS
  [ACL 2025] A Neural-Symbolic Self-Training Framework
  ☆112Updated 3 months ago
• rookie-joe / AutoPSV
  ☆49Updated 10 months ago
• GAIR-NLP / alignment-for-honesty
  ☆75Updated last year
• sail-sg / CPO
  [NeurIPS 2024] The official implementation of paper: Chain of Preference Optimization: Improving Chain-of-Thought Reasoning in LLMs.
  ☆127Updated 6 months ago
• CriticBench / CriticBench
  [ACL 2024 Findings] CriticBench: Benchmarking LLMs for Critique-Correct Reasoning
  ☆27Updated last year
• princeton-nlp / QuRating
  [ICML 2024] Selecting High-Quality Data for Training Language Models
  ☆187Updated last year
• FranxYao / FlanT5-CoT-Specialization
  Implementation of ICML 23 Paper: Specializing Smaller Language Models towards Multi-Step Reasoning.
  ☆131Updated 2 years ago
• RUCAIBox / JiuZhang3.0
  The code and data for the paper JiuZhang3.0
  ☆49Updated last year
• OpenMOSS / Say-I-Dont-Know
  [ICML'2024] Can AI Assistants Know What They Don't Know?
  ☆83Updated last year
• PKU-Alignment / aligner
  [NeurIPS 2024 Oral] Aligner: Efficient Alignment by Learning to Correct
  ☆185Updated 8 months ago
• princeton-nlp / MQuAKE
  [EMNLP 2023] MQuAKE: Assessing Knowledge Editing in Language Models via Multi-Hop Questions
  ☆115Updated last year
• inclusionAI / PromptCoT
  A unified suite for generating elite reasoning problems and training high-performance LLMs, including pioneering attention-free architect…
  ☆65Updated 3 months ago
• ShadeCloak / ADORA
  ☆46Updated 5 months ago
• yyDing1 / ScaleQuest
  [ACL-25] We introduce ScaleQuest, a scalable, novel and cost-effective data synthesis method to unleash the reasoning capability of LLMs.
  ☆67Updated 10 months ago
• JoeYing1019 / UltraTool
  [ACL2024] Planning, Creation, Usage: Benchmarking LLMs for Comprehensive Tool Utilization in Real-World Complex Scenarios
  ☆63Updated last month
• FreedomIntelligence / OVM
  ☆68Updated last year
• starrYYxuan / LeCo
  This the implementation of LeCo
  ☆31Updated 8 months ago
• WangHanLinHenry / SPA-RL-Agent
  Official code for paper "SPA-RL: Reinforcing LLM Agent via Stepwise Progress Attribution"
  ☆42Updated last week
• open-compass / CriticEval
  [NeurIPS 2024] A comprehensive benchmark for evaluating critique ability of LLMs
  ☆46Updated 9 months ago
• Linear95 / APO
  Code for ACL2024 paper - Adversarial Preference Optimization (APO).
  ☆56Updated last year
• ernie-research / Tool-Augmented-Reward-Model
  [ICLR'24 spotlight] Tool-Augmented Reward Modeling
  ☆51Updated 3 months ago
• shuyhere / about-super-alignment
  Feeling confused about super alignment? Here is a reading list
  ☆43Updated last year
• TianHongZXY / RLVR-Decomposed
  Implementation for the paper "The Surprising Effectiveness of Negative Reinforcement in LLM Reasoning"
  ☆102Updated 3 weeks ago
• YuxiXie / SelfEval-Guided-Decoding
  ☆100Updated last year
• PremiLab-Math / MathCheck
  [ICLR 2025] Is Your Model Really A Good Math Reasoner? Evaluating Mathematical Reasoning with Checklist
  ☆33Updated 10 months ago
• lancopku / label-words-are-anchors
  Repository for Label Words are Anchors: An Information Flow Perspective for Understanding In-Context Learning
  ☆164Updated last year