idavidrein / gpqaLinks
GPQA: A Graduate-Level Google-Proof Q&A Benchmark
☆408Updated last year
Alternatives and similar repositories for gpqa
Users that are interested in gpqa are comparing it to the libraries listed below
Sorting:
- The code and data for "MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmark" [NeurIPS 2024]☆292Updated 7 months ago
- Automatic evals for LLMs☆533Updated 3 months ago
- Reproducible, flexible LLM evaluations☆251Updated 2 months ago
- Official repository for the paper "LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code"☆670Updated 2 months ago
- Benchmarking LLMs with Challenging Tasks from Real Users☆241Updated 11 months ago
- A simple unified framework for evaluating LLMs☆248Updated 5 months ago
- A project to improve skills of large language models☆568Updated this week
- RewardBench: the first evaluation tool for reward models.☆640Updated 3 months ago
- [ACL'24] Selective Reflection-Tuning: Student-Selected Data Recycling for LLM Instruction-Tuning☆362Updated last year
- LOFT: A 1 Million+ Token Long-Context Benchmark☆212Updated 3 months ago
- Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Them☆515Updated last year
- Code for STaR: Bootstrapping Reasoning With Reasoning (NeurIPS 2022)☆211Updated 2 years ago
- Benchmarking long-form factuality in large language models. Original code for our paper "Long-form factuality in large language models".☆641Updated last month
- ☆466Updated last year
- ☆192Updated 5 months ago
- ☆541Updated 10 months ago
- The official evaluation suite and dynamic data release for MixEval.☆249Updated 10 months ago
- Code for Quiet-STaR☆740Updated last year
- Arena-Hard-Auto: An automatic LLM benchmark.☆932Updated 3 months ago
- Implementation of the Quiet-STAR paper (https://arxiv.org/pdf/2403.09629.pdf)☆54Updated last year
- [NeurIPS'25] Official codebase for "SWE-RL: Advancing LLM Reasoning via Reinforcement Learning on Open Software Evolution"☆602Updated 6 months ago
- Code for Paper: Training Software Engineering Agents and Verifiers with SWE-Gym [ICML 2025]☆547Updated 2 months ago
- Code for NeurIPS'24 paper 'Grokked Transformers are Implicit Reasoners: A Mechanistic Journey to the Edge of Generalization'☆230Updated 2 months ago
- Code and data for "Lost in the Middle: How Language Models Use Long Contexts"☆360Updated last year
- ICML 2024: Improving Factuality and Reasoning in Language Models through Multiagent Debate☆469Updated 5 months ago
- ☆318Updated 4 months ago
- (ICML 2024) Alphazero-like Tree-Search can guide large language model decoding and training☆280Updated last year
- Evaluation of LLMs on latest math competitions☆167Updated 2 weeks ago
- Code for the paper "Rethinking Benchmark and Contamination for Language Models with Rephrased Samples"☆311Updated last year
- An Analytical Evaluation Board of Multi-turn LLM Agents [NeurIPS 2024 Oral]☆354Updated last year