Public Goods Game (PGG) Benchmark: Contribute & Punish is a multi-agent benchmark that tests cooperative and self-interested strategies among Large Language Models (LLMs) in a resource-sharing economic scenario. Our experiment extends the classic PGG with a punishment phase, allowing players to penalize free-riders or retaliate against others.
☆43Apr 10, 2025Updated last year
Alternatives and similar repositories for pgg_bench
Users that are interested in pgg_bench are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A multi-agent benchmark where eight LLMs play a money-driven elimination game with private transfers and a buyout endgame, and are ranked…☆20May 27, 2026Updated 4 months ago
- Multi-Agent Step Race Benchmark: Assessing LLM Collaboration and Deception Under Pressure. A multi-player “step-race” that challenges LLM…☆92Dec 9, 2025Updated 10 months ago
- Systemic, uninstructed collusion among frontier LLMs in a simulated bidding environment☆22Jul 15, 2025Updated last year
- LLM Divergent Thinking Creativity Benchmark. LLMs generate 25 unique words that start with a given letter with no connections to each oth…☆37Mar 20, 2025Updated last year
- LLM Persuasion Benchmark tests whether one language model can change another model’s stated position over the course of a multi-turn conv…☆35Mar 27, 2026Updated 6 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Thematic Generalization Benchmark: measures how effectively various LLMs can infer a narrow or specific "theme" (category/rule) from a sm…☆74Apr 16, 2026Updated 6 months ago
- Benchmark evaluating LLMs on their ability to create and resist disinformation. Includes comprehensive testing across major models (Claud…☆36Mar 20, 2025Updated last year
- A benchmark for conversational bargaining by language models. In each 20‑round match one LLM plays buyer, one plays seller, and both hold…☆49Jun 23, 2026Updated 3 months ago
- Benchmark that evaluates LLMs using 759 NYT Connections puzzles extended with extra trick words☆246Oct 8, 2026Updated last week
- Hallucinations (Confabulations) Document-Based Benchmark for RAG. Includes human-verified questions and answers.☆249Aug 7, 2025Updated last year
- A multi-player tournament benchmark that tests LLMs in social reasoning, strategy, and deception. Players engage in public and private co…☆298Jan 7, 2026Updated 9 months ago
- LLM benchmark and leaderboard for narrator-bias sycophancy, opposite-narrator contradictions, and judgment consistency.☆66Aug 6, 2026Updated 2 months ago
- This benchmark tests how well LLMs incorporate a set of 10 mandatory story elements (characters, objects, core concepts, attributes, moti…☆459Updated this week
- Various LLM Benchmarks☆26Feb 20, 2026Updated 7 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆12Dec 21, 2024Updated last year
- A 20M RWKV v6 can do nonogram☆13Oct 18, 2024Updated 2 years ago
- ☆10Jan 26, 2025Updated last year
- ☆16Feb 1, 2025Updated last year
- An agent skill that plays ARC-AGI-3. One rule: say what an action will do before you spend it. Claude Code on Opus 5 finished all 25 publ…☆90Aug 19, 2026Updated last month
- Countdown Game Distill&RL☆48Sep 5, 2025Updated last year
- An implementation of the Anthropic's paper and essay on "A statistical approach to model evaluations"☆16Oct 6, 2025Updated last year
- Code for EMNLP 2022 paper “Distilled Dual-Encoder Model for Vision-Language Understanding”☆31May 1, 2023Updated 3 years ago
- Open source code and data for AAAI 2022 Oral Paper "Text is no more Enough! A Benchmark for Profile-based Spoken Language Understanding"☆36May 26, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆10Oct 28, 2019Updated 6 years ago
- ☆19Aug 1, 2024Updated 2 years ago
- ☆24Dec 28, 2024Updated last year
- Movie Service using Micronaut and GraphQL☆18Dec 12, 2018Updated 7 years ago
- The official repo for "CodeScaler: Scaling Code LLM Training and Test-Time Inference via Execution-Free Reward Models"☆50Sep 27, 2026Updated 2 weeks ago
- SemBleu: A Robust Metric for AMR Parsing Evaluation☆12Feb 22, 2021Updated 5 years ago
- Using self-play to augment multi-turn text-to-SQL datasets☆13Oct 20, 2022Updated 3 years ago
- ☆95Jul 7, 2025Updated last year
- 💻 Terminal-Agent with Human-in-the-Loop Learning☆43Jan 16, 2026Updated 9 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- code for the table-based open domain question answering project, with paper title: "Reasoning over Hybrid Chain for Table-and-Text Open D…☆12Sep 16, 2022Updated 4 years ago
- Source Data of ACL2021 paper "Syntax-Enhanced Pre-trained Model"☆11Jun 1, 2021Updated 5 years ago
- ☆19Apr 14, 2025Updated last year
- Lightweight Llama 3 8B Inference Engine in CUDA C☆52Mar 21, 2025Updated last year
- Can LLMs generate code-mixed sentences through zero-shot prompting?☆11Apr 18, 2023Updated 3 years ago
- Diverse Demonstrations Improve In-context Compositional Generalization☆13Jul 7, 2023Updated 3 years ago
- Code for our paper "AMR-DA: Data augmentation by abstract meaning representation" in ACL 2022☆14May 17, 2022Updated 4 years ago