idavidrein / gpqaLinks
GPQA: A Graduate-Level Google-Proof Q&A Benchmark
☆461Updated last year
Alternatives and similar repositories for gpqa
Users that are interested in gpqa are comparing it to the libraries listed below
Sorting:
- The code and data for "MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmark" [NeurIPS 2024]☆327Updated 2 months ago
- A simple unified framework for evaluating LLMs☆258Updated 9 months ago
- Automatic evals for LLMs☆575Updated last month
- Benchmarking LLMs with Challenging Tasks from Real Users☆245Updated last year
- Reproducible, flexible LLM evaluations☆327Updated 2 months ago
- RewardBench: the first evaluation tool for reward models.☆683Updated last week
- Official repository for the paper "LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code"☆770Updated 6 months ago
- A project to improve skills of large language models☆786Updated this week
- ☆559Updated last year
- Code for NeurIPS'24 paper 'Grokked Transformers are Implicit Reasoners: A Mechanistic Journey to the Edge of Generalization'☆234Updated 6 months ago
- ☆481Updated last year
- The official evaluation suite and dynamic data release for MixEval.☆254Updated last year
- [ACL'24] Selective Reflection-Tuning: Student-Selected Data Recycling for LLM Instruction-Tuning☆366Updated last year
- Official repo for paper: "Reinforcement Learning for Reasoning in Small LLMs: What Works and What Doesn't"☆273Updated 3 months ago
- Code for the paper "Rethinking Benchmark and Contamination for Language Models with Rephrased Samples"☆315Updated 2 years ago
- LOFT: A 1 Million+ Token Long-Context Benchmark☆225Updated 7 months ago
- Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Them☆544Updated last year
- Official repository for ORPO☆469Updated last year
- Arena-Hard-Auto: An automatic LLM benchmark.☆988Updated 7 months ago
- ☆202Updated 9 months ago
- Benchmarking long-form factuality in large language models. Original code for our paper "Long-form factuality in large language models".☆665Updated this week
- Code for Quiet-STaR☆742Updated last year
- Code and data for "Lost in the Middle: How Language Models Use Long Contexts"☆374Updated 2 years ago
- Meta Agents Research Environments is a comprehensive platform designed to evaluate AI agents in dynamic, realistic scenarios. Unlike stat…☆418Updated this week
- ☆327Updated last year
- ☆328Updated 7 months ago
- ☆242Updated last year
- Implementation of the Quiet-STAR paper (https://arxiv.org/pdf/2403.09629.pdf)☆54Updated last year
- Evaluation of LLMs on latest math competitions☆213Updated last month
- A simple toolkit for benchmarking LLMs on mathematical reasoning tasks. 🧮✨☆273Updated last year