sam-paech / diplobenchLinks
Benchmark for LLMs playing full press diplomacy
☆56Updated 6 months ago
Alternatives and similar repositories for diplobench
Users that are interested in diplobench are comparing it to the libraries listed below
Sorting:
- A graph visualization of attention☆57Updated 4 months ago
- ☆123Updated last year
- An introduction to LLM Sampling☆79Updated 9 months ago
- A framework for optimizing DSPy programs with RL☆177Updated this week
- ☆58Updated 2 months ago
- PageRank for LLMs☆50Updated 2 weeks ago
- ☆39Updated last year
- look how they massacred my boy☆64Updated 11 months ago
- A framework for orchestrating AI agents using a mermaid graph☆77Updated last year
- A strongly typed Python DSL for developing message passing multi agent systems☆53Updated last year
- Synthetic data derived by templating, few shot prompting, transformations on public domain corpora, and monte carlo tree search.☆32Updated 6 months ago
- explore token trajectory trees on instruct and base models☆133Updated 3 months ago
- Plotting (entropy, varentropy) for small LMs☆99Updated 4 months ago
- An easy-to-understand framework for LLM samplers that rewind and revise generated tokens☆146Updated 7 months ago
- ☆67Updated last year
- Verbosity control for AI agents☆65Updated last year
- A distributed agent orchestration framework for market agents☆105Updated last month
- Simple Graph Memory for AI applications☆90Updated 4 months ago
- Chat Markup Language conversation library☆55Updated last year
- Tools to make language models a bit easier to use☆54Updated 2 months ago
- ☆166Updated 9 months ago
- An automated tool for discovering insights from research papaer corpora☆139Updated last year
- Public repository containing METR's DVC pipeline for eval data analysis☆110Updated 5 months ago
- Inference-time scaling for LLMs-as-a-judge.☆299Updated 3 weeks ago
- WIP - Allows you to create DSPy pipelines using ComfyUI☆195Updated 9 months ago
- Training an LLM to use a calculator with multi-turn reinforcement learning, achieving a **62% absolute increase in evaluation accuracy**.☆52Updated 4 months ago
- Benchmark that evaluates LLMs using 759 NYT Connections puzzles extended with extra trick words☆146Updated this week
- Train your own SOTA deductive reasoning model☆106Updated 6 months ago
- Implementation of the board game Codenames, re-imagined as a collaborative game between LLM agents☆109Updated 6 months ago
- ☆22Updated 3 months ago