lechmazur / confabulationsView external linksLinks
Hallucinations (Confabulations) Document-Based Benchmark for RAG. Includes human-verified questions and answers.
☆243Aug 7, 2025Updated 6 months ago
Alternatives and similar repositories for confabulations
Users that are interested in confabulations are comparing it to the libraries listed below
Sorting:
- Thematic Generalization Benchmark: measures how effectively various LLMs can infer a narrow or specific "theme" (category/rule) from a sm…☆63Sep 22, 2025Updated 4 months ago
- Benchmark evaluating LLMs on their ability to create and resist disinformation. Includes comprehensive testing across major models (Claud…☆31Mar 20, 2025Updated 10 months ago
- Multi-Agent Step Race Benchmark: Assessing LLM Collaboration and Deception Under Pressure. A multi-player “step-race” that challenges LLM…☆85Dec 9, 2025Updated 2 months ago
- LLM Divergent Thinking Creativity Benchmark. LLMs generate 25 unique words that start with a given letter with no connections to each oth…☆35Mar 20, 2025Updated 10 months ago
- This benchmark tests how well LLMs incorporate a set of 10 mandatory story elements (characters, objects, core concepts, attributes, moti…☆342Feb 6, 2026Updated last week
- An extension for oobabooga/text-generation-webui that automatically unloads and reloads your model.☆17Apr 22, 2024Updated last year
- Attend - to what matters.☆17Feb 22, 2025Updated 11 months ago
- German "Who Wants To Be A Millionaire" LLM Benchmarking.☆48Dec 28, 2025Updated last month
- The DPAB-α Benchmark☆32Jan 15, 2025Updated last year
- Benchmark that evaluates LLMs using 759 NYT Connections puzzles extended with extra trick words☆193Feb 6, 2026Updated last week
- Smart proxy for LLM APIs that enables model-specific parameter control, automatic mode switching (like Qwen3's /think and /no_think), and…☆50May 19, 2025Updated 8 months ago
- A collection of prompts to challenge the reasoning abilities of large language models in presence of misguiding information☆458Jul 31, 2025Updated 6 months ago
- ☆19Jan 10, 2026Updated last month
- AI management tool☆119Nov 9, 2024Updated last year
- ☆19Oct 2, 2023Updated 2 years ago
- private-machine is an AI companion system with emotion, needs and goals simulation. Very silly, not based on real science.☆28Nov 13, 2025Updated 3 months ago
- Public Goods Game (PGG) Benchmark: Contribute & Punish is a multi-agent benchmark that tests cooperative and self-interested strategies a…☆39Apr 10, 2025Updated 10 months ago
- A curated list of resources related to structured generation 🔥☆23Jul 25, 2025Updated 6 months ago
- dify 知识库检索工具☆13Apr 3, 2025Updated 10 months ago
- Who needs o1 anyways. Add CoT to any OpenAI compatible endpoint.☆44Sep 17, 2024Updated last year
- A Tampermonkey / Userscript extension to add autocompletion lists to form fields in a webpage☆75Sep 14, 2025Updated 5 months ago
- ☆24Jan 22, 2025Updated last year
- RENT (Reinforcement Learning via Entropy Minimization) is an unsupervised method for training reasoning LLMs.☆41Oct 31, 2025Updated 3 months ago
- ☆12May 30, 2025Updated 8 months ago
- Modified Beam Search with periodical restart☆12Sep 12, 2024Updated last year
- GisPy: A Tool for Measuring Gist Inference Score in Text https://aclanthology.org/2022.wnu-1.5/☆13Jul 1, 2024Updated last year
- Yet another frontend for LLM, written using .NET and WinUI 3☆10Sep 14, 2025Updated 5 months ago
- Realtime News and Information Eval☆16Nov 19, 2025Updated 2 months ago
- ☆52Feb 17, 2025Updated 11 months ago
- BlockRank makes LLMs efficient and scalable for RAG and in-context ranking☆40Dec 12, 2025Updated 2 months ago
- A collection of Basalt (Bash) packages.☆13Feb 6, 2026Updated last week
- LLM CLI Interface - Extremely Convenient and Fast☆12Sep 22, 2025Updated 4 months ago
- [ACL'24] WebCiteS: Attributed Query-Focused Summarization on Chinese Web Search Results with Citations☆13Sep 11, 2024Updated last year
- entropix style sampling + GUI☆27Oct 30, 2024Updated last year
- Comparison of the output quality of quantization methods, using Llama 3, transformers, GGUF, EXL2.☆165May 16, 2024Updated last year
- Yans2019 Annotation hackathon☆14May 22, 2023Updated 2 years ago
- Mixture-of-Ollamas☆30Aug 12, 2024Updated last year
- Crow is a Desktop AI Assistant☆32Aug 9, 2024Updated last year
- Code for paper: "Privately generating tabular data using language models".☆15Jun 13, 2023Updated 2 years ago