Alternatives and similar repositories for ConsisEval

Users that are interested in ConsisEval are comparing it to the libraries listed below

• microsoft / ConstrainedReasoner
  ☆13Updated last year
• bespokelabsai / verifiers
  Verifiers for LLM Reinforcement Learning
  ☆80Updated 8 months ago
• SWE-bench / sb-cli
  Run SWE-bench evaluations remotely
  ☆49Updated 4 months ago
• LuLuLuyi / LongHeads
  [EMNLP'24] LongHeads: Multi-Head Attention is Secretly a Long Context Processor
  ☆31Updated last year
• MasterVito / SwS
  Official Repo for SwS: A Weakness-driven Problem Synthesis Framework in RL for LLM Reasoning
  ☆42Updated 2 months ago
• choosewhatulike / case2code
  ☆17Updated 9 months ago
• allenai / IFBench
  ☆96Updated last week
• microsoft / LEMA
  official repo for the paper "Learning From Mistakes Makes LLM Better Reasoner"
  ☆59Updated 2 years ago
• sunblaze-ucb / reasoning_ladder
  ☆35Updated 7 months ago
• MLE-Dojo / MLE-Dojo
  ☆88Updated 2 months ago
• GAIR-NLP / OlympicArena
  [NeurIPS 2024] OlympicArena: Benchmarking Multi-discipline Cognitive Reasoning for Superintelligent AI
  ☆107Updated 10 months ago
• MobileLLM / ParaThinker
  ☆41Updated 2 months ago
• TIGER-AI-Lab / MAmmoTH2
  Official code for "MAmmoTH2: Scaling Instructions from the Web" [NeurIPS 2024]
  ☆149Updated last year
• OSU-NLP-Group / Mind2Web-2
  [NeurIPS'25 D&B] Mind2Web-2 Benchmark: Evaluating Agentic Search with Agent-as-a-Judge
  ☆96Updated 3 weeks ago
• GAIR-NLP / scaleeval
  Scalable Meta-Evaluation of LLMs as Evaluators
  ☆43Updated last year
• QwenLM / ProcessBench
  Official repository for ACL 2025 paper "ProcessBench: Identifying Process Errors in Mathematical Reasoning"
  ☆181Updated 7 months ago
• HKUNLP / critic-rl
  [ICML 2025] Teaching Language Models to Critique via Reinforcement Learning
  ☆120Updated 8 months ago
• GAIR-NLP / AIME-Preview
  ☆79Updated 10 months ago
• lifan-yuan / CRAFT
  Code for ICLR 2024 paper "CRAFT: Customizing LLMs by Creating and Retrieving from Specialized Toolsets"
  ☆60Updated last year
• google-deepmind / latent-multi-hop-reasoning
  [ACL 2024] Do Large Language Models Latently Perform Multi-Hop Reasoning?
  ☆85Updated 9 months ago
• PRIME-RL / RL-Compositionality
  FROM $f(x)$ AND $g(x)$ TO $f(g(x))$: LLMs Learn New Skills in RL by Composing Old Ones
  ☆55Updated 2 months ago
• THU-KEG / Agentic-Reward-Modeling
  [ACL 2025] Agentic Reward Modeling: Integrating Human Preferences with Verifiable Correctness Signals for Reliable Reward Systems
  ☆119Updated 7 months ago
• QwenLM / CodeElo
  CodeElo: Benchmarking Competition-level Code Generation of LLMs with Human-comparable Elo Ratings
  ☆58Updated 11 months ago
• Kwai-Klear / KlearReasoner
  Klear-Reasoner: Advancing Reasoning Capability via Gradient-Preserving Clipping Policy Optimization
  ☆81Updated 2 weeks ago
• microsoft / EpiCoder
  Implementation for "EpiCoder: Encompassing Diversity and Complexity in Code Generation" (ICML 2025)
  ☆22Updated 7 months ago
• OSU-NLP-Group / Middleware
  Middleware for LLMs: Tools Are Instrumental for Language Agents in Complex Environments (EMNLP'2024)
  ☆37Updated last year
• test-time-interaction / TTI
  ☆69Updated 7 months ago
• OSU-NLP-Group / llm-planning-eval
  [ACL'24] Code and data of paper "When is Tree Search Useful for LLM Planning? It Depends on the Discriminator"
  ☆54Updated last year
• texttron / BrowseComp-Plus
  BrowseComp-Plus: A More Fair and Transparent Evaluation Benchmark of Deep-Research Agent
  ☆147Updated 3 weeks ago
• CodeCreator / datatools
  Common tools for data processing
  ☆22Updated last month