Hallucinations (Confabulations) Document-Based Benchmark for RAG. Includes human-verified questions and answers.
☆243Aug 7, 2025Updated 7 months ago
Alternatives and similar repositories for confabulations
Users that are interested in confabulations are comparing it to the libraries listed below
Sorting:
- Thematic Generalization Benchmark: measures how effectively various LLMs can infer a narrow or specific "theme" (category/rule) from a sm…☆63Sep 22, 2025Updated 5 months ago
- Benchmark evaluating LLMs on their ability to create and resist disinformation. Includes comprehensive testing across major models (Claud…☆32Mar 20, 2025Updated 11 months ago
- Multi-Agent Step Race Benchmark: Assessing LLM Collaboration and Deception Under Pressure. A multi-player “step-race” that challenges LLM…☆85Dec 9, 2025Updated 3 months ago
- LLM Divergent Thinking Creativity Benchmark. LLMs generate 25 unique words that start with a given letter with no connections to each oth…☆35Mar 20, 2025Updated 11 months ago
- This benchmark tests how well LLMs incorporate a set of 10 mandatory story elements (characters, objects, core concepts, attributes, moti…☆350Feb 6, 2026Updated last month
- An extension for oobabooga/text-generation-webui that automatically unloads and reloads your model.☆17Apr 22, 2024Updated last year
- German "Who Wants To Be A Millionaire" LLM Benchmarking.☆47Updated this week
- The DPAB-α Benchmark☆32Jan 15, 2025Updated last year
- Benchmark that evaluates LLMs using 759 NYT Connections puzzles extended with extra trick words☆198Updated this week
- Smart proxy for LLM APIs that enables model-specific parameter control, automatic mode switching (like Qwen3's /think and /no_think), and…☆51May 19, 2025Updated 9 months ago
- A collection of prompts to challenge the reasoning abilities of large language models in presence of misguiding information☆463Jul 31, 2025Updated 7 months ago
- ☆19Jan 10, 2026Updated last month
- AI management tool☆121Nov 9, 2024Updated last year
- A multi-player tournament benchmark that tests LLMs in social reasoning, strategy, and deception. Players engage in public and private co…☆302Jan 7, 2026Updated 2 months ago
- ☆19Oct 2, 2023Updated 2 years ago
- private-machine is an AI companion system with emotion, needs and goals simulation. Very silly, not based on real science.☆30Feb 26, 2026Updated last week
- Who needs o1 anyways. Add CoT to any OpenAI compatible endpoint.☆44Sep 17, 2024Updated last year
- dify 知识库检索工具☆13Apr 3, 2025Updated 11 months ago
- A Tampermonkey / Userscript extension to add autocompletion lists to form fields in a webpage☆75Sep 14, 2025Updated 5 months ago
- RENT (Reinforcement Learning via Entropy Minimization) is an unsupervised method for training reasoning LLMs.☆41Oct 31, 2025Updated 4 months ago
- ☆24Jan 22, 2025Updated last year
- Realtime News and Information Eval☆17Nov 19, 2025Updated 3 months ago
- ☆12May 30, 2025Updated 9 months ago
- Fast LLM swapping with sleep/wake support, compatible with vllm, llama.cpp, etc. llama-swap fork.☆30Feb 14, 2026Updated 3 weeks ago
- GisPy: A Tool for Measuring Gist Inference Score in Text https://aclanthology.org/2022.wnu-1.5/☆13Jul 1, 2024Updated last year
- Modified Beam Search with periodical restart☆12Sep 12, 2024Updated last year
- This repo contains the source code for RULER: What’s the Real Context Size of Your Long-Context Language Models?☆1,468Nov 13, 2025Updated 3 months ago
- ☆45Updated this week
- [ACL'24] WebCiteS: Attributed Query-Focused Summarization on Chinese Web Search Results with Citations☆13Sep 11, 2024Updated last year
- LLM CLI Interface - Extremely Convenient and Fast☆12Sep 22, 2025Updated 5 months ago
- ☆52Feb 17, 2025Updated last year
- BlockRank makes LLMs efficient and scalable for RAG and in-context ranking☆41Dec 12, 2025Updated 2 months ago
- entropix style sampling + GUI☆27Oct 30, 2024Updated last year
- Comparison of the output quality of quantization methods, using Llama 3, transformers, GGUF, EXL2.☆167May 16, 2024Updated last year
- Code for paper: "Privately generating tabular data using language models".☆15Jun 13, 2023Updated 2 years ago
- ☆28Sep 23, 2025Updated 5 months ago
- story based implementation for sequential thinking☆15Dec 15, 2025Updated 2 months ago
- Crow is a Desktop AI Assistant☆32Aug 9, 2024Updated last year
- Mixture-of-Ollamas☆30Aug 12, 2024Updated last year