Alternatives and similar repositories for ConsisEval

Users that are interested in ConsisEval are comparing it to the libraries listed below

• icip-cas / Verifier-Engineering
  Search, Verify and Feedback: Towards Next Generation Post-training Paradigm of Foundation Models via Verifier Engineering
  ☆63Updated last year
• LuLuLuyi / LongHeads
  [EMNLP'24] LongHeads: Multi-Head Attention is Secretly a Long Context Processor
  ☆31Updated last year
• QwenLM / ProcessBench
  Official repository for ACL 2025 paper "ProcessBench: Identifying Process Errors in Mathematical Reasoning"
  ☆180Updated 7 months ago
• zankner / CLoud
  Critique-out-Loud Reward Models
  ☆70Updated last year
• microsoft / LEMA
  official repo for the paper "Learning From Mistakes Makes LLM Better Reasoner"
  ☆59Updated 2 years ago
• qtli / GSM-Plus
  GSM-Plus: Data, Code, and Evaluation for Enhancing Robust Mathematical Reasoning in Math Word Problems.
  ☆64Updated last year
• TIGER-AI-Lab / MAmmoTH2
  Official code for "MAmmoTH2: Scaling Instructions from the Web" [NeurIPS 2024]
  ☆149Updated last year
• edenbiran / HoppingTooLate
  Exploring the Limitations of Large Language Models on Multi-Hop Queries
  ☆29Updated 9 months ago
• lil-lab / icrl
  ☆30Updated 10 months ago
• texttron / BrowseComp-Plus
  BrowseComp-Plus: A More Fair and Transparent Evaluation Benchmark of Deep-Research Agent
  ☆130Updated last week
• ernie-research / Tool-Augmented-Reward-Model
  [ICLR'24 spotlight] Tool-Augmented Reward Modeling
  ☆51Updated 6 months ago
• OSU-NLP-Group / llm-planning-eval
  [ACL'24] Code and data of paper "When is Tree Search Useful for LLM Planning? It Depends on the Discriminator"
  ☆54Updated last year
• microsoft / advNLG
  ☆25Updated 3 years ago
• GAIR-NLP / MetaCritique
  Evaluate the Quality of Critique
  ☆36Updated last year
• LiqiangJing / DSBench
  [ICLR 2025] DSBench: How Far are Data Science Agents from Becoming Data Science Experts?
  ☆94Updated 4 months ago
• WindyLee0822 / Process_Q_Model
  official implementation of paper "Process Reward Model with Q-value Rankings"
  ☆65Updated 10 months ago
• GAIR-NLP / ReasonEval
  [AAAI 2025 oral] Evaluating Mathematical Reasoning Beyond Accuracy
  ☆76Updated 2 months ago
• hkust-nlp / WebExplorer
  The official repo of "WebExplorer: Explore and Evolve for Training Long-Horizon Web Agents"
  ☆89Updated 2 months ago
• xlang-ai / BRIGHT
  [ICLR 2025] BRIGHT: A Realistic and Challenging Benchmark for Reasoning-Intensive Retrieval
  ☆179Updated 3 months ago
• zhangxy-2019 / critique-GRPO
  ☆50Updated 2 months ago
• meowpass / FollowComplexInstruction
  Official implementation of the paper "From Complex to Simple: Enhancing Multi-Constraint Complex Instruction Following Ability of Large L…
  ☆53Updated last year
• koalazf99 / nanoverl
  Collections of RLxLM experiments using minimal codes
  ☆14Updated 10 months ago
• QwenLM / CodeElo
  CodeElo: Benchmarking Competition-level Code Generation of LLMs with Human-comparable Elo Ratings
  ☆58Updated 10 months ago
• HKUNLP / STRING
  [ICLR'25] Data and code for our paper "Why Does the Effective Context Length of LLMs Fall Short?"
  ☆78Updated last year
• orionw / FollowIR
  FollowIR: Evaluating and Teaching Information Retrieval Models to Follow Instructions
  ☆49Updated last year
• PremiLab-Math / MathCheck
  [ICLR 2025] Is Your Model Really A Good Math Reasoner? Evaluating Mathematical Reasoning with Checklist
  ☆33Updated last year
• SparkJiao / dpo-trajectory-reasoning
  [EMNLP 2024] Source code for the paper "Learning Planning-based Reasoning with Trajectory Collection and Process Rewards Synthesizing".
  ☆83Updated 11 months ago
• PRIME-RL / ImplicitPRM
  Repo of paper "Free Process Rewards without Process Labels"
  ☆168Updated 9 months ago
• KbsdJames / Omni-MATH
  The official repository of the Omni-MATH benchmark.
  ☆88Updated 11 months ago
• microsoft / ConstrainedReasoner
  ☆13Updated last year