Public Goods Game (PGG) Benchmark: Contribute & Punish is a multi-agent benchmark that tests cooperative and self-interested strategies among Large Language Models (LLMs) in a resource-sharing economic scenario. Our experiment extends the classic PGG with a punishment phase, allowing players to penalize free-riders or retaliate against others.
☆41Apr 10, 2025Updated last year
Alternatives and similar repositories for pgg_bench
Users that are interested in pgg_bench are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A multi-agent benchmark where eight LLMs play a money-driven elimination game with private transfers and a buyout endgame, and are ranked…☆19May 27, 2026Updated 3 months ago
- Adversarial multi-turn benchmark for LLM debate quality, using side-swapped matchups and multi-model judging to rank models by judged deb…☆33Updated this week
- A benchmark for testing whether LLM judges keep the same preference when two lightly edited versions of the same story are shown in oppos…☆16Jun 11, 2026Updated 2 months ago
- Multi-Agent Step Race Benchmark: Assessing LLM Collaboration and Deception Under Pressure. A multi-player “step-race” that challenges LLM…☆90Dec 9, 2025Updated 8 months ago
- Systemic, uninstructed collusion among frontier LLMs in a simulated bidding environment☆19Jul 15, 2025Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Documents the style side of the short-story Creative Writing LLM benchmark: we generated many short stories with a range of LLMs, then an…☆26Dec 18, 2025Updated 8 months ago
- LLM Persuasion Benchmark tests whether one language model can change another model’s stated position over the course of a multi-turn conv…☆33Mar 27, 2026Updated 5 months ago
- Thematic Generalization Benchmark: measures how effectively various LLMs can infer a narrow or specific "theme" (category/rule) from a sm…☆73Apr 16, 2026Updated 4 months ago
- A benchmark for conversational bargaining by language models. In each 20‑round match one LLM plays buyer, one plays seller, and both hold…☆46Jun 23, 2026Updated 2 months ago
- Benchmark that evaluates LLMs using 759 NYT Connections puzzles extended with extra trick words☆240Updated this week
- Hallucinations (Confabulations) Document-Based Benchmark for RAG. Includes human-verified questions and answers.☆249Aug 7, 2025Updated last year
- ☆28Feb 26, 2026Updated 6 months ago
- LLM benchmark and leaderboard for narrator-bias sycophancy, opposite-narrator contradictions, and judgment consistency.☆59Aug 6, 2026Updated last month
- Various LLM Benchmarks☆26Feb 20, 2026Updated 6 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- This benchmark tests how well LLMs incorporate a set of 10 mandatory story elements (characters, objects, core concepts, attributes, moti…☆436Updated this week
- ☆12Dec 21, 2024Updated last year
- A 20M RWKV v6 can do nonogram☆13Oct 18, 2024Updated last year
- ☆10Jan 26, 2025Updated last year
- Countdown Game Distill&RL☆48Sep 5, 2025Updated last year
- Learning to Rewrite for Non-Autoregressive Neural Machine Translation☆21Dec 23, 2021Updated 4 years ago
- Code for EMNLP 2022 paper “Distilled Dual-Encoder Model for Vision-Language Understanding”☆31May 1, 2023Updated 3 years ago
- ☆19Jan 10, 2026Updated 7 months ago
- SVGBench: A challenging LLM benchmark that tests knowledge, coding, physical reasoning capabilities of LLMs.☆78Feb 12, 2026Updated 6 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆13Mar 10, 2025Updated last year
- ☆10Oct 28, 2019Updated 6 years ago
- ☆19Aug 1, 2024Updated 2 years ago
- ☆24Dec 28, 2024Updated last year
- A curated list of outstanding, actively maintained vector search frameworks and engines, libraries, cloud services, and research papers f…☆18Mar 21, 2026Updated 5 months ago
- Script that finds .ass perspective for a known rectangle->tetragon projection☆31Aug 6, 2019Updated 7 years ago
- The official repo for "CodeScaler: Scaling Code LLM Training and Test-Time Inference via Execution-Free Reward Models"☆50Mar 26, 2026Updated 5 months ago
- This repository is intended as a comprehensive guide to prepare for interviews focused on generative AI. It serves as a one-stop resource…☆11Dec 13, 2024Updated last year
- ☆10Jun 30, 2022Updated 4 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Research Artifact For Our Submission To VLDB☆11Oct 27, 2021Updated 4 years ago
- SemBleu: A Robust Metric for AMR Parsing Evaluation☆12Feb 22, 2021Updated 5 years ago
- Using self-play to augment multi-turn text-to-SQL datasets☆13Oct 20, 2022Updated 3 years ago
- Code and dataset for Polyglot Prompting: Multilingual Multitask Prompt Training.☆18Dec 7, 2022Updated 3 years ago
- 💻 Terminal-Agent with Human-in-the-Loop Learning☆42Jan 16, 2026Updated 7 months ago
- code for the table-based open domain question answering project, with paper title: "Reasoning over Hybrid Chain for Table-and-Text Open D…☆12Sep 16, 2022Updated 3 years ago
- Code for Dissecting Generation Modes for Abstractive Summarization Models via Ablation and Attribution (ACL2021)☆13Jun 2, 2021Updated 5 years ago