idavidrein / gpqaLinks
GPQA: A Graduate-Level Google-Proof Q&A Benchmark
☆452Updated last year
Alternatives and similar repositories for gpqa
Users that are interested in gpqa are comparing it to the libraries listed below
Sorting:
- The code and data for "MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmark" [NeurIPS 2024]☆321Updated last month
- A simple unified framework for evaluating LLMs☆259Updated 8 months ago
- RewardBench: the first evaluation tool for reward models.☆674Updated 6 months ago
- Evaluation of LLMs on latest math competitions☆211Updated 2 weeks ago
- A project to improve skills of large language models☆734Updated this week
- Automatic evals for LLMs☆570Updated 2 weeks ago
- Official repository for the paper "LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code"☆753Updated 5 months ago
- Benchmarking LLMs with Challenging Tasks from Real Users☆246Updated last year
- Reproducible, flexible LLM evaluations☆312Updated last month
- The official evaluation suite and dynamic data release for MixEval.☆253Updated last year
- ☆477Updated last year
- [ACL'24] Selective Reflection-Tuning: Student-Selected Data Recycling for LLM Instruction-Tuning☆366Updated last year
- ☆559Updated last year
- Code for NeurIPS'24 paper 'Grokked Transformers are Implicit Reasoners: A Mechanistic Journey to the Edge of Generalization'☆234Updated 5 months ago
- Code for Quiet-STaR☆742Updated last year
- Public repository for "The Surprising Effectiveness of Test-Time Training for Abstract Reasoning"☆341Updated last month
- Code for Paper: Training Software Engineering Agents and Verifiers with SWE-Gym [ICML 2025]☆609Updated 5 months ago
- Official repository for ORPO☆468Updated last year
- ☆201Updated 8 months ago
- PyTorch building blocks for the OLMo ecosystem☆656Updated this week
- Official repo for paper: "Reinforcement Learning for Reasoning in Small LLMs: What Works and What Doesn't"☆271Updated 2 months ago
- [NeurIPS'25] Official codebase for "SWE-RL: Advancing LLM Reasoning via Reinforcement Learning on Open Software Evolution"☆650Updated 9 months ago
- LOFT: A 1 Million+ Token Long-Context Benchmark☆222Updated 6 months ago
- Implementation of the Quiet-STAR paper (https://arxiv.org/pdf/2403.09629.pdf)☆54Updated last year
- Repo for Rho-1: Token-level Data Selection & Selective Pretraining of LLMs.☆453Updated last year
- ☆1,035Updated last year
- [ICLR'25] BigCodeBench: Benchmarking Code Generation Towards AGI☆466Updated this week
- A benchmark that challenges language models to code solutions for scientific problems☆165Updated 2 weeks ago
- ☆1,052Updated 6 months ago
- ☆329Updated 7 months ago