lechmazur / writingLinks
This benchmark tests how well LLMs incorporate a set of 10 mandatory story elements (characters, objects, core concepts, attributes, motivations, etc.) in a short creative story
☆310Updated 2 weeks ago
Alternatives and similar repositories for writing
Users that are interested in writing are comparing it to the libraries listed below
Sorting:
- A benchmark for emotional intelligence in large language models☆365Updated last year
- Hallucinations (Confabulations) Document-Based Benchmark for RAG. Includes human-verified questions and answers.☆229Updated 2 months ago
- ☆134Updated 5 months ago
- ☆315Updated 2 months ago
- Public Goods Game (PGG) Benchmark: Contribute & Punish is a multi-agent benchmark that tests cooperative and self-interested strategies a…☆39Updated 6 months ago
- Multi-Agent Step Race Benchmark: Assessing LLM Collaboration and Deception Under Pressure. A multi-player “step-race” that challenges LLM…☆73Updated last month
- An easy-to-understand framework for LLM samplers that rewind and revise generated tokens☆145Updated 7 months ago
- ☆57Updated 3 weeks ago
- ☆270Updated 4 months ago
- ☆162Updated 2 months ago
- Prompt-to-Leaderboard☆256Updated 5 months ago
- Benchmark that evaluates LLMs using 759 NYT Connections puzzles extended with extra trick words☆147Updated 3 weeks ago
- AI management tool☆121Updated 11 months ago
- A benchmark for role-playing language models☆105Updated 4 months ago
- Autonomously train research-agent LLMs on custom data using reinforcement learning and self-verification.☆667Updated 6 months ago
- Guaranteed Structured Output from any Language Model via Hierarchical State Machines☆145Updated this week
- Evaling and unaligning Chinese LLM censorship☆65Updated 5 months ago
- ☆102Updated last month
- A pipeline parallel training script for LLMs.☆157Updated 5 months ago
- ☆434Updated last year
- ☆166Updated 9 months ago
- A multimodal, function calling powered LLM webui.☆215Updated last year
- Thematic Generalization Benchmark: measures how effectively various LLMs can infer a narrow or specific "theme" (category/rule) from a sm…☆63Updated 2 weeks ago
- Merge Transformers language models by use of gradient parameters.☆208Updated last year
- Coding problems used in aider's polyglot benchmark☆182Updated 9 months ago
- A comprehensive repository of reasoning tasks for LLMs (and beyond)☆449Updated last year
- Generate Synthetic Data Using OpenAI, MistralAI or AnthropicAI☆221Updated last year
- Easily view and modify JSON datasets for large language models☆83Updated 4 months ago
- OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.☆172Updated 8 months ago
- ☆156Updated 5 months ago