lechmazur / confabulationsLinks
Hallucinations (Confabulations) Document-Based Benchmark for RAG. Includes human-verified questions and answers.
☆183Updated this week
Alternatives and similar repositories for confabulations
Users that are interested in confabulations are comparing it to the libraries listed below
Sorting:
- ☆131Updated 2 months ago
- Benchmark that evaluates LLMs using 651 NYT Connections puzzles extended with extra trick words☆119Updated this week
- An easy-to-understand framework for LLM samplers that rewind and revise generated tokens☆140Updated 4 months ago
- AI management tool☆118Updated 8 months ago
- This benchmark tests how well LLMs incorporate a set of 10 mandatory story elements (characters, objects, core concepts, attributes, moti…☆250Updated last month
- ☆307Updated 3 months ago
- Guaranteed Structured Output from any Language Model via Hierarchical State Machines☆140Updated last month
- Multi-Agent Step Race Benchmark: Assessing LLM Collaboration and Deception Under Pressure. A multi-player “step-race” that challenges LLM…☆55Updated last month
- ☆156Updated 2 months ago
- ☆204Updated last month
- A benchmark for emotional intelligence in large language models☆315Updated 11 months ago
- ☆95Updated 6 months ago
- ☆209Updated 4 months ago
- Generate Synthetic Data Using OpenAI, MistralAI or AnthropicAI☆221Updated last year
- ☆101Updated last month
- klmbr - a prompt pre-processing technique to break through the barrier of entropy while generating text with LLMs☆78Updated 9 months ago
- Official repository for "DynaSaur: Large Language Agents Beyond Predefined Actions"☆345Updated 6 months ago
- A simple tool that let's you explore different possible paths that an LLM might sample.☆174Updated 2 months ago
- ☆132Updated 6 months ago
- An extension that lets the AI take the wheel, allowing it to use the mouse and keyboard, recognize UI elements, and prompt itself :3...no…☆125Updated 8 months ago
- Distributed Inference for mlx LLm☆93Updated 11 months ago
- Serving LLMs in the HF-Transformers format via a PyFlask API☆71Updated 10 months ago
- ☆214Updated last month
- Public Goods Game (PGG) Benchmark: Contribute & Punish is a multi-agent benchmark that tests cooperative and self-interested strategies a…☆37Updated 3 months ago
- A flexible, adaptive classification system for dynamic text classification☆336Updated 3 weeks ago
- Transplants vocabulary between language models, enabling the creation of draft models for speculative decoding WITHOUT retraining.☆31Updated 3 months ago
- Minimal Linux OS with a Model Context Protocol (MCP) gateway to expose local capabilities to LLMs.☆257Updated 3 weeks ago
- ☆157Updated last year
- Letting Claude Code develop his own MCP tools :)☆114Updated 4 months ago
- A python package for developing AI applications with local LLMs.☆150Updated 6 months ago