Public Goods Game (PGG) Benchmark: Contribute & Punish is a multi-agent benchmark that tests cooperative and self-interested strategies among Large Language Models (LLMs) in a resource-sharing economic scenario. Our experiment extends the classic PGG with a punishment phase, allowing players to penalize free-riders or retaliate against others.
☆40Apr 10, 2025Updated last year
Alternatives and similar repositories for pgg_bench
Users that are interested in pgg_bench are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Multi-Agent Step Race Benchmark: Assessing LLM Collaboration and Deception Under Pressure. A multi-player “step-race” that challenges LLM…☆85Dec 9, 2025Updated 4 months ago
- LLM Divergent Thinking Creativity Benchmark. LLMs generate 25 unique words that start with a given letter with no connections to each oth…☆34Mar 20, 2025Updated last year
- Benchmark that evaluates LLMs using 759 NYT Connections puzzles extended with extra trick words☆202Updated this week
- Thematic Generalization Benchmark: measures how effectively various LLMs can infer a narrow or specific "theme" (category/rule) from a sm…☆67Updated this week
- A benchmark for conversational bargaining by language models. In each 20‑round match one LLM plays buyer, one plays seller, and both hold…☆33Aug 21, 2025Updated 7 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- A multi-player tournament benchmark that tests LLMs in social reasoning, strategy, and deception. Players engage in public and private co…☆301Jan 7, 2026Updated 3 months ago
- This benchmark tests how well LLMs incorporate a set of 10 mandatory story elements (characters, objects, core concepts, attributes, moti…☆360Feb 6, 2026Updated 2 months ago
- Various LLM Benchmarks☆25Feb 20, 2026Updated last month
- An AI Agent using MoonBit☆12Nov 29, 2024Updated last year
- Countdown Game Distill&RL☆47Sep 5, 2025Updated 7 months ago
- Learning to Rewrite for Non-Autoregressive Neural Machine Translation☆21Dec 23, 2021Updated 4 years ago
- ☆14Apr 12, 2026Updated last week
- Measuring Thinking Efficiency in Reasoning Models - Research Repository☆39Dec 2, 2025Updated 4 months ago
- ☆17Apr 14, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Extension module for vertx-groovy adding methods and syntaxic sugar☆14May 23, 2016Updated 9 years ago
- a converter to markdown format for TeXmacs.☆11Apr 8, 2020Updated 6 years ago
- Code for EMNLP 2022 paper “Distilled Dual-Encoder Model for Vision-Language Understanding”☆31May 1, 2023Updated 2 years ago
- Open source code and data for AAAI 2022 Oral Paper "Text is no more Enough! A Benchmark for Profile-based Spoken Language Understanding"☆35May 26, 2024Updated last year
- The Universal Anaphora Scorer☆15Sep 2, 2024Updated last year
- ☆19Jan 10, 2026Updated 3 months ago
- anydice roller☆12May 26, 2018Updated 7 years ago
- ☆95Jul 7, 2025Updated 9 months ago
- Research Artifact For Our Submission To VLDB☆11Oct 27, 2021Updated 4 years ago
- Serverless GPU API endpoints on Runpod - Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- ☆10Jun 30, 2022Updated 3 years ago
- This repository is intended as a comprehensive guide to prepare for interviews focused on generative AI. It serves as a one-stop resource…☆11Dec 13, 2024Updated last year
- SemBleu: A Robust Metric for AMR Parsing Evaluation☆12Feb 22, 2021Updated 5 years ago
- code for the table-based open domain question answering project, with paper title: "Reasoning over Hybrid Chain for Table-and-Text Open D…☆12Sep 16, 2022Updated 3 years ago
- Code for Dissecting Generation Modes for Abstractive Summarization Models via Ablation and Attribution (ACL2021)☆13Jun 2, 2021Updated 4 years ago
- Source Data of ACL2021 paper "Syntax-Enhanced Pre-trained Model"☆11Jun 1, 2021Updated 4 years ago
- PyTorch implementation of RWKV blocks☆32Jul 22, 2025Updated 8 months ago
- Repository of my thoughts on creating GPTs, and instructions and files for Better GPT Builder☆33Jan 29, 2024Updated 2 years ago
- Code for our paper "AMR-DA: Data augmentation by abstract meaning representation" in ACL 2022☆13May 17, 2022Updated 3 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- CHASE is a large-scale and pragmatic Chinese dataset for cross-database context-dependent text-to-SQL task (natural language interfaces f…☆10May 7, 2021Updated 4 years ago
- public dataset for followup-query analysis, accepted by AAAI2019☆15Aug 22, 2019Updated 6 years ago
- Can LLMs generate code-mixed sentences through zero-shot prompting?☆11Apr 18, 2023Updated 3 years ago
- Generate Your Own Private Morning Radio for Commute☆32Feb 5, 2025Updated last year
- Visual Hash for matching copies of visually similar images.☆16Mar 17, 2025Updated last year
- Diverse Demonstrations Improve In-context Compositional Generalization☆12Jul 7, 2023Updated 2 years ago
- Experiments on the impact of depth in transformers and SSMs.☆41Oct 23, 2025Updated 5 months ago