GPQA: A Graduate-Level Google-Proof Q&A Benchmark
☆551Sep 30, 2024Updated 2 years ago
Alternatives and similar repositories for gpqa
Users that are interested in gpqa are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- The code and data for "MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmark" [NeurIPS 2024]☆435Mar 18, 2026Updated 8 months ago
- Official repository for the paper "LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code"☆980Jul 16, 2025Updated last year
- Measuring Massive Multitask Language Understanding | ICLR 2021☆1,625May 28, 2023Updated 3 years ago
- A benchmark that challenges language models to code solutions for scientific problems☆246Updated this week
- ☆4,710Apr 22, 2026Updated 6 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- The MATH Dataset (NeurIPS 2021)☆1,397Sep 6, 2025Updated last year
- Arena-Hard-Auto: An automatic LLM benchmark.☆1,087Updated this week
- Humanity's Last Exam☆1,749Sep 23, 2026Updated last month
- Code for the paper "Evaluating Large Language Models Trained on Code"☆3,431Oct 16, 2026Updated last month
- ☆1,208Jan 10, 2026Updated 10 months ago
- ☆84Mar 11, 2025Updated last year
- A framework for few-shot evaluation of language models.☆14,515Nov 4, 2026Updated 2 weeks ago
- SWE-bench: Can Language Models Resolve Real-world Github Issues?☆6,231Sep 18, 2026Updated 2 months ago
- ☆776Jun 13, 2024Updated 2 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- 800,000 step-level correctness labels on LLM solutions to MATH problems☆2,152Jun 1, 2023Updated 3 years ago
- ☆30Dec 27, 2024Updated last year
- Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Them☆577Jun 25, 2024Updated 2 years ago
- An automatic evaluator for instruction-following language models. Human-validated, high-quality, cheap, and fast.☆2,026Aug 9, 2025Updated last year
- [NeurIPS 2024] OlympicArena: Benchmarking Multi-discipline Cognitive Reasoning for Superintelligent AI☆106Mar 6, 2025Updated last year
- [ACL 2024 Findings] MathBench: A Comprehensive Multi-Level Difficulty Mathematics Evaluation Dataset☆117May 22, 2025Updated last year
- Doing simple retrieval from LLM models at various context lengths to measure accuracy☆2,408Jun 8, 2026Updated 5 months ago
- LiveBench: A Challenging, Contamination-Free LLM Benchmark☆1,355Oct 18, 2026Updated last month
- Holistic Evaluation of Language Models (HELM) is an open source Python framework created by the Center for Research on Foundation Models …☆2,975Sep 1, 2026Updated 2 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- RewardBench: the first evaluation tool for reward models.☆749Oct 14, 2026Updated last month
- Benchmarking Benchmark Leakage in Large Language Models☆61May 20, 2024Updated 2 years ago
- ☆62Aug 22, 2024Updated 2 years ago
- The official repository of the Omni-MATH benchmark.☆92Dec 22, 2024Updated last year
- Rigourous evaluation of LLM-synthesized code - NeurIPS 2023 & COLM 2024☆1,840Oct 2, 2025Updated last year
- Code for the paper "Rethinking Benchmark and Contamination for Language Models with Rephrased Samples"☆326Dec 20, 2023Updated 2 years ago
- TruthfulQA: Measuring How Models Imitate Human Falsehoods☆957Jan 16, 2025Updated last year
- Repo for Rho-1: Token-level Data Selection & Selective Pretraining of LLMs.☆475Apr 18, 2024Updated 2 years ago
- ☆136Jul 8, 2024Updated 2 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆13Jul 2, 2025Updated last year
- xVerify: Efficient Answer Verifier for Reasoning Model Evaluations☆152Oct 28, 2026Updated 3 weeks ago
- Renderer for the harmony response format to be used with gpt-oss☆4,548Apr 8, 2026Updated 7 months ago
- ☆342Jun 5, 2025Updated last year
- The official evaluation suite and dynamic data release for MixEval.☆253Nov 10, 2024Updated 2 years ago
- Code for RATIONALYST: Pre-training Process-Supervision for Improving Reasoning https://arxiv.org/pdf/2410.01044☆36Oct 3, 2024Updated 2 years ago
- [ICLR 2025 DATA-FM] Training and Evaluating Language Models with Template-based Data Generation (https://arxiv.org/abs/2411.18104)☆13May 13, 2026Updated 6 months ago
Are these results useful?