lechmazur / confabulationsLinks
Hallucinations (Confabulations) Document-Based Benchmark for RAG. Includes human-verified questions and answers.
☆236Updated 3 months ago
Alternatives and similar repositories for confabulations
Users that are interested in confabulations are comparing it to the libraries listed below
Sorting:
- ☆135Updated 6 months ago
- Benchmark that evaluates LLMs using 759 NYT Connections puzzles extended with extra trick words☆157Updated last week
- ☆326Updated 3 months ago
- Guaranteed Structured Output from any Language Model via Hierarchical State Machines☆145Updated last month
- ☆288Updated 3 weeks ago
- Multi-Agent Step Race Benchmark: Assessing LLM Collaboration and Deception Under Pressure. A multi-player “step-race” that challenges LLM…☆76Updated 2 months ago
- Official repository for "NoLiMa: Long-Context Evaluation Beyond Literal Matching"☆166Updated 4 months ago
- An easy-to-understand framework for LLM samplers that rewind and revise generated tokens☆145Updated 9 months ago
- klmbr - a prompt pre-processing technique to break through the barrier of entropy while generating text with LLMs☆84Updated last year
- Generate Synthetic Data Using OpenAI, MistralAI or AnthropicAI☆221Updated last year
- A benchmark for emotional intelligence in large language models☆382Updated last year
- This benchmark tests how well LLMs incorporate a set of 10 mandatory story elements (characters, objects, core concepts, attributes, moti…☆316Updated 2 months ago
- ☆158Updated 7 months ago
- Conduct in-depth research with AI-driven insights : DeepDive is a command-line tool that leverages web searches and AI models to generate…☆42Updated last year
- AI management tool☆121Updated last year
- Fast parallel LLM inference for MLX☆232Updated last year
- ☆163Updated 3 months ago
- Transplants vocabulary between language models, enabling the creation of draft models for speculative decoding WITHOUT retraining.☆44Updated 3 weeks ago
- Easily view and modify JSON datasets for large language models☆84Updated 6 months ago
- Official repository for "DynaSaur: Large Language Agents Beyond Predefined Actions"☆348Updated 11 months ago
- ☆208Updated 2 months ago
- A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.☆99Updated 4 months ago
- A multi-player tournament benchmark that tests LLMs in social reasoning, strategy, and deception. Players engage in public and private co…☆293Updated 3 months ago
- Public Goods Game (PGG) Benchmark: Contribute & Punish is a multi-agent benchmark that tests cooperative and self-interested strategies a…☆39Updated 7 months ago
- ☆106Updated 3 months ago
- Coding problems used in aider's polyglot benchmark☆190Updated 11 months ago
- Pivotal Token Search☆131Updated 4 months ago
- Enhancing LLMs with LoRA☆176Updated last month
- Low-Rank adapter extraction for fine-tuned transformers models☆179Updated last year
- ☆107Updated 3 weeks ago