Public Goods Game (PGG) Benchmark: Contribute & Punish is a multi-agent benchmark that tests cooperative and self-interested strategies among Large Language Models (LLMs) in a resource-sharing economic scenario. Our experiment extends the classic PGG with a punishment phase, allowing players to penalize free-riders or retaliate against others.
☆41Apr 10, 2025Updated last year
Alternatives and similar repositories for pgg_bench
Users that are interested in pgg_bench are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Adversarial multi-turn benchmark for LLM debate quality, using side-swapped matchups and multi-model judging to rank models by judged deb…☆33Updated this week
- Multi-Agent Step Race Benchmark: Assessing LLM Collaboration and Deception Under Pressure. A multi-player “step-race” that challenges LLM…☆90Dec 9, 2025Updated 9 months ago
- The BAZAAR challenges LLMs to navigate the double-auction marketplace, where buyers and sellers must make strategic decisions with incomp…☆39Jul 30, 2025Updated last year
- Documents the style side of the short-story Creative Writing LLM benchmark: we generated many short stories with a range of LLMs, then an…☆27Dec 18, 2025Updated 9 months ago
- Thematic Generalization Benchmark: measures how effectively various LLMs can infer a narrow or specific "theme" (category/rule) from a sm…☆73Apr 16, 2026Updated 5 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- A benchmark for conversational bargaining by language models. In each 20‑round match one LLM plays buyer, one plays seller, and both hold…☆46Jun 23, 2026Updated 3 months ago
- Benchmark that evaluates LLMs using 759 NYT Connections puzzles extended with extra trick words☆243Updated this week
- Hallucinations (Confabulations) Document-Based Benchmark for RAG. Includes human-verified questions and answers.☆250Aug 7, 2025Updated last year
- A multi-player tournament benchmark that tests LLMs in social reasoning, strategy, and deception. Players engage in public and private co…☆298Jan 7, 2026Updated 8 months ago
- ☆28Feb 26, 2026Updated 7 months ago
- LLM benchmark and leaderboard for narrator-bias sycophancy, opposite-narrator contradictions, and judgment consistency.☆60Aug 6, 2026Updated last month
- This benchmark tests how well LLMs incorporate a set of 10 mandatory story elements (characters, objects, core concepts, attributes, moti…☆448Sep 5, 2026Updated 3 weeks ago
- ☆12Dec 21, 2024Updated last year
- ☆16Feb 1, 2025Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Countdown Game Distill&RL☆48Sep 5, 2025Updated last year
- Learning to Rewrite for Non-Autoregressive Neural Machine Translation☆21Dec 23, 2021Updated 4 years ago
- Semantic Parser Localizer (SPL) code repository☆10Mar 15, 2021Updated 5 years ago
- A sports game summarization dataset in Chinese.☆10Oct 26, 2020Updated 5 years ago
- SVGBench: A challenging LLM benchmark that tests knowledge, coding, physical reasoning capabilities of LLMs.☆79Feb 12, 2026Updated 7 months ago
- ☆24Dec 28, 2024Updated last year
- A curated list of outstanding, actively maintained vector search frameworks and engines, libraries, cloud services, and research papers f…☆18Mar 21, 2026Updated 6 months ago
- node.js module for using hydrus api☆12Dec 8, 2022Updated 3 years ago
- The official repo for "CodeScaler: Scaling Code LLM Training and Test-Time Inference via Execution-Free Reward Models"☆50Mar 26, 2026Updated 6 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- This repository is intended as a comprehensive guide to prepare for interviews focused on generative AI. It serves as a one-stop resource…☆11Dec 13, 2024Updated last year
- ☆93Jul 7, 2025Updated last year
- Research Artifact For Our Submission To VLDB☆11Oct 27, 2021Updated 4 years ago
- SemBleu: A Robust Metric for AMR Parsing Evaluation☆12Feb 22, 2021Updated 5 years ago
- Code and dataset for Polyglot Prompting: Multilingual Multitask Prompt Training.☆18Dec 7, 2022Updated 3 years ago
- An anydice clone in python☆12Jan 6, 2016Updated 10 years ago
- 💻 Terminal-Agent with Human-in-the-Loop Learning☆43Jan 16, 2026Updated 8 months ago
- code for the table-based open domain question answering project, with paper title: "Reasoning over Hybrid Chain for Table-and-Text Open D…☆12Sep 16, 2022Updated 4 years ago
- Code for Dissecting Generation Modes for Abstractive Summarization Models via Ablation and Attribution (ACL2021)☆13Jun 2, 2021Updated 5 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Lightweight Llama 3 8B Inference Engine in CUDA C☆52Mar 21, 2025Updated last year
- Repository of my thoughts on creating GPTs, and instructions and files for Better GPT Builder☆33Jan 29, 2024Updated 2 years ago
- Calculation of power indices (e.g. Banzhaf power index, Shapley-Shubik power index etc)☆17Nov 26, 2025Updated 10 months ago
- Can LLMs generate code-mixed sentences through zero-shot prompting?☆11Apr 18, 2023Updated 3 years ago
- Examples of Using DBTunnel☆11Apr 24, 2024Updated 2 years ago
- Image downloader for various imageboards and image albums written in Python.☆10Sep 21, 2019Updated 7 years ago
- Code for our paper "AMR-DA: Data augmentation by abstract meaning representation" in ACL 2022☆14May 17, 2022Updated 4 years ago