Alternatives and similar repositories for multi-challenge

Users that are interested in multi-challenge are comparing it to the libraries listed below

• QwenLM / ProcessBench
  Official repository for ACL 2025 paper "ProcessBench: Identifying Process Errors in Mathematical Reasoning"
  ☆179Updated 6 months ago
• princeton-nlp / ProLong
  Homepage for ProLong (Princeton long-context language models) and paper "How to Train Long-Context Language Models (Effectively)"
  ☆240Updated 2 months ago
• TIGER-AI-Lab / CritiqueFineTuning
  Code for "Critique Fine-Tuning: Learning to Critique is More Effective than Learning to Imitate" [COLM 2025]
  ☆179Updated 5 months ago
• princeton-nlp / HELMET
  The HELMET Benchmark
  ☆187Updated 3 months ago
• chujiezheng / LLM-Extrapolation
  Official repository for ACL 2025 paper "Model Extrapolation Expedites Alignment"
  ☆76Updated 6 months ago
• HKUNLP / STRING
  [ICLR'25] Data and code for our paper "Why Does the Effective Context Length of LLMs Fall Short?"
  ☆78Updated last year
• allenai / WildBench
  Benchmarking LLMs with Challenging Tasks from Real Users
  ☆246Updated last year
• GAIR-NLP / OctoThinker
  Revisiting Mid-training in the Era of Reinforcement Learning Scaling
  ☆180Updated 4 months ago
• zankner / CLoud
  Critique-out-Loud Reward Models
  ☆70Updated last year
• TIGER-AI-Lab / LongICLBench
  Code and Data for "Long-context LLMs Struggle with Long In-context Learning" [TMLR2025]
  ☆110Updated 9 months ago
• da03 / Internalize_CoT_Step_by_Step
  ☆200Updated 7 months ago
• princeton-nlp / CEPE
  [ACL 2024] Long-Context Language Modeling with Parallel Encodings
  ☆167Updated last year
• google-deepmind / loft
  LOFT: A 1 Million+ Token Long-Context Benchmark
  ☆218Updated 5 months ago
• xlang-ai / BRIGHT
  [ICLR 2025] BRIGHT: A Realistic and Challenging Benchmark for Reasoning-Intensive Retrieval
  ☆179Updated 2 months ago
• xingyaoww / mint-bench
  Official Repo for ICLR 2024 paper MINT: Evaluating LLMs in Multi-turn Interaction with Tools and Language Feedback by Xingyao Wang*, Ziha…
  ☆134Updated last year
• princeton-nlp / LLMBar
  [ICLR 2024] Evaluating Large Language Models at Evaluating Instruction Following
  ☆134Updated last year
• TIGER-AI-Lab / General-Reasoner
  General Reasoner: Advancing LLM Reasoning Across All Domains [NeurIPS25]
  ☆209Updated last week
• HKUNLP / critic-rl
  [ICML 2025] Teaching Language Models to Critique via Reinforcement Learning
  ☆118Updated 7 months ago
• yifanzhang-pro / AutoMathText
  [ACL 2025 Findings] Autonomous Data Selection with Zero-shot Generative Classifiers for Mathematical Texts (As Huggingface Daily Papers: …
  ☆88Updated 2 weeks ago
• TIGER-AI-Lab / MAmmoTH2
  Official code for "MAmmoTH2: Scaling Instructions from the Web" [NeurIPS 2024]
  ☆149Updated last year
• genrm-star / genrm-critiques
  GenRM-CoT: Data release for verification rationales
  ☆66Updated last year
• ars22 / scaling-LLM-math-synthetic-data
  Code and data used in the paper: "Training on Incorrect Synthetic Data via RL Scales LLM Math Reasoning Eight-Fold"
  ☆31Updated last year
• Zayne-sprague / MuSR
  ☆56Updated last year
• WildEval / ZeroEval
  A simple unified framework for evaluating LLMs
  ☆254Updated 7 months ago
• google-deepmind / bbeh
  ☆105Updated 7 months ago
• icip-cas / awesome-auto-alignment
  Collection of papers for scalable automated alignment.
  ☆94Updated last year
• eddycmu / demystify-long-cot
  ☆327Updated 6 months ago
• qtli / GSM-Plus
  GSM-Plus: Data, Code, and Evaluation for Enhancing Robust Mathematical Reasoning in Math Word Problems.
  ☆63Updated last year
• SparkJiao / dpo-trajectory-reasoning
  [EMNLP 2024] Source code for the paper "Learning Planning-based Reasoning with Trajectory Collection and Process Rewards Synthesizing".
  ☆82Updated 10 months ago
• ScalerLab / JudgeBench
  ☆105Updated last year