A benchmark for testing whether LLM judges keep the same preference when two lightly edited versions of the same story are shown in opposite orders.
☆18Jun 11, 2026Updated 4 months ago
Alternatives and similar repositories for position_bias
Users that are interested in position_bias are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Systemic, uninstructed collusion among frontier LLMs in a simulated bidding environment☆23Jul 15, 2025Updated last year
- A multi-agent benchmark where eight LLMs play a money-driven elimination game with private transfers and a buyout endgame, and are ranked…☆21May 27, 2026Updated 4 months ago
- Adversarial multi-turn benchmark for LLM debate quality, using side-swapped matchups and multi-model judging to rank models by judged deb…☆38Updated this week
- Thematic Generalization Benchmark: measures how effectively various LLMs can infer a narrow or specific "theme" (category/rule) from a sm…☆74Apr 16, 2026Updated 6 months ago
- The BAZAAR challenges LLMs to navigate the double-auction marketplace, where buyers and sellers must make strategic decisions with incomp…☆41Jul 30, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Public Goods Game (PGG) Benchmark: Contribute & Punish is a multi-agent benchmark that tests cooperative and self-interested strategies a…☆43Apr 10, 2025Updated last year
- LLM Persuasion Benchmark tests whether one language model can change another model’s stated position over the course of a multi-turn conv…☆35Mar 27, 2026Updated 6 months ago
- Documents the style side of the short-story Creative Writing LLM benchmark: we generated many short stories with a range of LLMs, then an…☆28Dec 18, 2025Updated 10 months ago
- Multi-Agent Step Race Benchmark: Assessing LLM Collaboration and Deception Under Pressure. A multi-player “step-race” that challenges LLM…☆92Dec 9, 2025Updated 10 months ago
- Hallucinations (Confabulations) Document-Based Benchmark for RAG. Includes human-verified questions and answers.☆249Aug 7, 2025Updated last year
- LLM benchmark and leaderboard for narrator-bias sycophancy, opposite-narrator contradictions, and judgment consistency.☆68Aug 6, 2026Updated 2 months ago
- This benchmark tests how well LLMs incorporate a set of 10 mandatory story elements (characters, objects, core concepts, attributes, moti…☆461Oct 14, 2026Updated last week
- A benchmark for conversational bargaining by language models. In each 20‑round match one LLM plays buyer, one plays seller, and both hold…☆49Jun 23, 2026Updated 4 months ago
- A Python library that includes an end-to-end 3D Gaussian splatting pipeline without requiring the compilation of hundreds of dependencies☆13Jul 4, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Aldebaran is a cross-platform (Discord and Revolt) multi-purposes bot which offers useful features to DiscordRPG players along with many …☆11Jan 9, 2024Updated 2 years ago
- ☆10Nov 15, 2020Updated 5 years ago
- An IPC based on Websockets. Fast, stable, and reliable☆14Sep 1, 2023Updated 3 years ago
- Gemini plugin for Claude Code - reviews, and adversarial reviews to Google's Gemini CLI☆20Apr 24, 2026Updated 5 months ago
- A REST API for neural machine translation☆14Jun 11, 2026Updated 4 months ago
- 🏛️ Direito Lux - SaaS para monitoramento automatizado de processos jurídicos com integração DataJud (CNJ)☆18Jul 18, 2025Updated last year
- Plugin Claude Code para escritórios de advocacia — orquestrador inteligente com 17 skills jurídicas, intake estruturado e base DREI compl…☆22Apr 27, 2026Updated 5 months ago
- All about creating a dataset, preprocessing images, and creating an actual model to solve captcha☆13Jul 27, 2026Updated 2 months ago
- Source code for paper "Trajectory of Alternating Direction Method of Multipliers and Adaptive Acceleration" of NeurIPS 2019☆10Jan 25, 2024Updated 2 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- A multi-player tournament benchmark that tests LLMs in social reasoning, strategy, and deception. Players engage in public and private co…☆298Jan 7, 2026Updated 9 months ago
- Demos of neural image editing☆11Mar 15, 2021Updated 5 years ago
- Auto-scaling cluster handler for discord.py☆15Jan 11, 2021Updated 5 years ago
- Torrent meta-search☆24Nov 1, 2022Updated 3 years ago
- Yet another frontend for LLM, written using .NET and WinUI 3☆11Sep 14, 2025Updated last year
- readonly python fsspec implementation for IPFS☆30Dec 16, 2025Updated 10 months ago
- Biblioteca gratuita com 49 prompts jurídicos em português, prontos para usar no Claude.☆39Updated this week
- Identify VMess packets in network traffic☆13Nov 21, 2022Updated 3 years ago
- A sleek, customizable interface for managing LLMs with responsive design and easy agent personalization.☆19Aug 30, 2024Updated 2 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Source code for the Apple reproduction☆33Apr 23, 2021Updated 5 years ago
- A curated guide to the new generation of AI GTM tools☆27Jun 1, 2026Updated 4 months ago
- Raspador (sempre incompleto) de tribunais do sistema judiciário.☆54Updated this week
- Autonomous experiment loop skill for Claude Code — port of pi-autoresearch☆38Mar 18, 2026Updated 7 months ago
- Helps you manage and autosave your extension's options, separately for each additional permission☆18Jul 4, 2026Updated 3 months ago
- Unofficial implementation JEN-1 Composer: A Unified Framework for High-Fidelity Multi-Track Music Generation(https://arxiv.org/abs/2310.1…☆32Jan 19, 2024Updated 2 years ago
- a character-ai like UI for LLM☆10Dec 3, 2024Updated last year