lechmazur / confabulationsLinks
Hallucinations (Confabulations) Document-Based Benchmark for RAG. Includes human-verified questions and answers.
☆229Updated 2 months ago
Alternatives and similar repositories for confabulations
Users that are interested in confabulations are comparing it to the libraries listed below
Sorting:
- ☆134Updated 5 months ago
- A benchmark for emotional intelligence in large language models☆365Updated last year
- An easy-to-understand framework for LLM samplers that rewind and revise generated tokens☆145Updated 7 months ago
- ☆315Updated 2 months ago
- Guaranteed Structured Output from any Language Model via Hierarchical State Machines☆145Updated this week
- Benchmark that evaluates LLMs using 759 NYT Connections puzzles extended with extra trick words☆147Updated 3 weeks ago
- Generate Synthetic Data Using OpenAI, MistralAI or AnthropicAI☆221Updated last year
- Official repository for "NoLiMa: Long-Context Evaluation Beyond Literal Matching"☆157Updated 2 months ago
- This benchmark tests how well LLMs incorporate a set of 10 mandatory story elements (characters, objects, core concepts, attributes, moti…☆310Updated 2 weeks ago
- klmbr - a prompt pre-processing technique to break through the barrier of entropy while generating text with LLMs☆79Updated last year
- AI management tool☆121Updated 11 months ago
- Multi-Agent Step Race Benchmark: Assessing LLM Collaboration and Deception Under Pressure. A multi-player “step-race” that challenges LLM…☆73Updated last month
- ☆156Updated 5 months ago
- ☆270Updated 4 months ago
- ☆162Updated 2 months ago
- Thematic Generalization Benchmark: measures how effectively various LLMs can infer a narrow or specific "theme" (category/rule) from a sm…☆63Updated 2 weeks ago
- ☆102Updated last month
- Conduct in-depth research with AI-driven insights : DeepDive is a command-line tool that leverages web searches and AI models to generate…☆42Updated last year
- ☆207Updated last month
- Transplants vocabulary between language models, enabling the creation of draft models for speculative decoding WITHOUT retraining.☆42Updated last month
- Official repository for "DynaSaur: Large Language Agents Beyond Predefined Actions"☆350Updated 9 months ago
- autologic is a Python package that implements the SELF-DISCOVER framework proposed in the paper SELF-DISCOVER: Large Language Models Self…☆60Updated last year
- A multi-player tournament benchmark that tests LLMs in social reasoning, strategy, and deception. Players engage in public and private co…☆290Updated last month
- ☆115Updated 9 months ago
- Smart proxy for LLM APIs that enables model-specific parameter control, automatic mode switching (like Qwen3's /think and /no_think), and…☆50Updated 4 months ago
- cli tool to quantize gguf, gptq, awq, hqq and exl2 models☆76Updated 9 months ago
- Cohere Toolkit is a collection of prebuilt components enabling users to quickly build and deploy RAG applications.☆29Updated 8 months ago
- Serving LLMs in the HF-Transformers format via a PyFlask API☆71Updated last year
- Enhancing LLMs with LoRA☆159Updated last month
- Client Code Examples, Use Cases and Benchmarks for Enterprise h2oGPTe RAG-Based GenAI Platform☆90Updated last month