Alternatives and similar repositories for gpqa

Users that are interested in gpqa are comparing it to the libraries listed below

• WildEval / ZeroEval
  A simple unified framework for evaluating LLMs
  ☆211Updated last month
• allenai / olmes
  Reproducible, flexible LLM evaluations
  ☆202Updated last week
• allenai / reward-bench
  RewardBench: the first evaluation tool for reward models.
  ☆566Updated last week
• TIGER-AI-Lab / MMLU-Pro
  The code and data for "MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmark" [NeurIPS 2024]
  ☆243Updated 2 months ago
• da03 / Internalize_CoT_Step_by_Step
  ☆171Updated 3 weeks ago
• mlfoundations / evalchemy
  Automatic evals for LLMs
  ☆388Updated this week
• waterhorse1 / LLM_Tree_Search
  (ICML 2024) Alphazero-like Tree-Search can guide large language model decoding and training
  ☆268Updated 11 months ago
• google-deepmind / loft
  LOFT: A 1 Million+ Token Long-Context Benchmark
  ☆193Updated 3 weeks ago
• OSU-NLP-Group / GrokkedTransformer
  Code for NeurIPS'24 paper 'Grokked Transformers are Implicit Reasoners: A Mechanistic Journey to the Edge of Generalization'
  ☆191Updated 5 months ago
• suzgunmirac / BIG-Bench-Hard
  Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Them
  ☆490Updated 10 months ago
• allenai / WildBench
  Benchmarking LLMs with Challenging Tasks from Real Users
  ☆222Updated 6 months ago
• ezelikman / quiet-star
  Code for Quiet-STaR
  ☆731Updated 8 months ago
• MARIO-Math-Reasoning / Super_MARIO
  ☆329Updated 3 months ago
• microsoft / rStar
  ☆527Updated last month
• ezelikman / STaR
  Code for STaR: Bootstrapping Reasoning With Reasoning (NeurIPS 2022)
  ☆205Updated 2 years ago
• huggingface / Math-Verify
  ☆691Updated 2 weeks ago
• zhentingqi / rStar
  ☆931Updated 3 months ago
• knoveleng / open-rs
  Official repo for paper: "Reinforcement Learning for Reasoning in Small LLMs: What Works and What Doesn't"
  ☆224Updated this week
• NovaSky-AI / SkyRL
  SkyRL-v0: Train Real-World Long-Horizon Agents via Reinforcement Learning
  ☆261Updated this week
• LiveCodeBench / LiveCodeBench
  Official repository for the paper "LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code"
  ☆467Updated 2 weeks ago
• google-deepmind / long-form-factuality
  Benchmarking long-form factuality in large language models. Original code for our paper "Long-form factuality in large language models".
  ☆607Updated 2 weeks ago
• expz / quiet-star
  Implementation of the Quiet-STAR paper (https://arxiv.org/pdf/2403.09629.pdf)
  ☆54Updated 9 months ago
• FranxYao / Long-Context-Data-Engineering
  Implementation of paper Data Engineering for Scaling Language Models to 128K Context
  ☆461Updated last year
• sail-sg / oat-zero
  A lightweight reproduction of DeepSeek-R1-Zero with indepth analysis of self-reflection behavior.
  ☆236Updated last month
• princeton-nlp / AutoCompressors
  [EMNLP 2023] Adapting Language Models to Compress Long Contexts
  ☆304Updated 8 months ago
• xlang-ai / DS-1000
  [ICML 2023] Data and code release for the paper "DS-1000: A Natural and Reliable Benchmark for Data Science Code Generation".
  ☆243Updated 6 months ago
• hkust-nlp / AgentBoard
  An Analytical Evaluation Board of Multi-turn LLM Agents [NeurIPS 2024 Oral]
  ☆314Updated 11 months ago
• YuxiXie / MCTS-DPO
  This is the repository that contains the source code for the Self-Evaluation Guided MCTS for online DPO.
  ☆309Updated 9 months ago
• Ber666 / ToolkenGPT
  ToolkenGPT: Augmenting Frozen Language Models with Massive Tools via Tool Embeddings - NeurIPS 2023 (oral)
  ☆262Updated last year
• eddycmu / demystify-long-cot
  ☆291Updated 2 months ago