Alternatives and similar repositories for gpqa:

Users that are interested in gpqa are comparing it to the libraries listed below

• OSU-NLP-Group / GrokkedTransformer
  Code for NeurIPS'24 paper 'Grokked Transformers are Implicit Reasoners: A Mechanistic Journey to the Edge of Generalization'
  ☆187Updated 4 months ago
• da03 / Internalize_CoT_Step_by_Step
  ☆166Updated last week
• allenai / olmes
  Reproducible, flexible LLM evaluations
  ☆191Updated last month
• microsoft / rStar
  ☆519Updated last week
• MARIO-Math-Reasoning / Super_MARIO
  ☆326Updated 2 months ago
• allenai / WildBench
  Benchmarking LLMs with Challenging Tasks from Real Users
  ☆221Updated 5 months ago
• allenai / reward-bench
  RewardBench: the first evaluation tool for reward models.
  ☆555Updated last month
• ZubinGou / math-evaluation-harness
  A simple toolkit for benchmarking LLMs on mathematical reasoning tasks. 🧮✨
  ☆203Updated last year
• eddycmu / demystify-long-cot
  ☆283Updated last month
• tianyi-lab / Reflection_Tuning
  [ACL'24] Selective Reflection-Tuning: Student-Selected Data Recycling for LLM Instruction-Tuning
  ☆354Updated 7 months ago
• mlfoundations / evalchemy
  Automatic evals for LLMs
  ☆373Updated this week
• booydar / babilong
  BABILong is a benchmark for LLM evaluation using the needle-in-a-haystack approach.
  ☆198Updated last week
• WildEval / ZeroEval
  A simple unified framework for evaluating LLMs
  ☆209Updated last week
• TIGER-AI-Lab / MMLU-Pro
  The code and data for "MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmark" [NeurIPS 2024]
  ☆230Updated last month
• project-numina / aimo-progress-prize
  ☆423Updated 9 months ago
• suzgunmirac / BIG-Bench-Hard
  Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Them
  ☆482Updated 10 months ago
• knoveleng / open-rs
  Official repo for paper: "Reinforcement Learning for Reasoning in Small LLMs: What Works and What Doesn't"
  ☆204Updated last month
• JinjieNi / MixEval
  The official evaluation suite and dynamic data release for MixEval.
  ☆235Updated 5 months ago
• huggingface / Math-Verify
  ☆647Updated 3 weeks ago
• facebookresearch / sweet_rl
  Benchmark and research code for the paper SWEET-RL Training Multi-Turn LLM Agents onCollaborative Reasoning Tasks
  ☆182Updated last week
• kyegomez / Lets-Verify-Step-by-Step
  "Improving Mathematical Reasoning with Process Supervision" by OPENAI
  ☆108Updated 2 weeks ago
• TIGER-AI-Lab / Program-of-Thoughts
  Data and Code for Program of Thoughts (TMLR 2023)
  ☆268Updated 11 months ago
• google-deepmind / loft
  LOFT: A 1 Million+ Token Long-Context Benchmark
  ☆190Updated this week
• zhentingqi / rStar
  ☆922Updated 3 months ago
• LiveCodeBench / LiveCodeBench
  Official repository for the paper "LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code"
  ☆440Updated this week
• diagram-of-thought / diagram-of-thought
  Official implementation of paper "On the Diagram of Thought" (https://arxiv.org/abs/2409.10038)
  ☆178Updated 3 weeks ago
• SWE-Gym / SWE-Gym
  Code for Paper: Training Software Engineering Agents and Verifiers with SWE-Gym
  ☆438Updated 3 weeks ago
• GAIR-NLP / ProX
  Offical Repo for "Programming Every Example: Lifting Pre-training Data Quality Like Experts at Scale"
  ☆236Updated last week
• bin123apple / MACM
  MACM: Utilizing a Multi-Agent System for Condition Mining in Solving Complex Mathematical Problems
  ☆86Updated 9 months ago
• iiis-ai / cumulative-reasoning
  Official implementation of paper "Cumulative Reasoning With Large Language Models" (https://arxiv.org/abs/2308.04371)
  ☆292Updated 7 months ago