lechmazur / confabulationsLinks
Hallucinations (Confabulations) Document-Based Benchmark for RAG. Includes human-verified questions and answers.
☆241Updated 5 months ago
Alternatives and similar repositories for confabulations
Users that are interested in confabulations are comparing it to the libraries listed below
Sorting:
- ☆135Updated 8 months ago
- Benchmark that evaluates LLMs using 759 NYT Connections puzzles extended with extra trick words☆190Updated last month
- AI management tool☆119Updated last year
- ☆304Updated 2 months ago
- klmbr - a prompt pre-processing technique to break through the barrier of entropy while generating text with LLMs☆86Updated last year
- Official repository for "NoLiMa: Long-Context Evaluation Beyond Literal Matching"☆179Updated 6 months ago
- Official repository for "DynaSaur: Large Language Agents Beyond Predefined Actions"☆353Updated last year
- ☆334Updated 5 months ago
- ☆209Updated 3 weeks ago
- An easy-to-understand framework for LLM samplers that rewind and revise generated tokens☆150Updated 2 weeks ago
- Generate Synthetic Data Using OpenAI, MistralAI or AnthropicAI☆222Updated last year
- Transplants vocabulary between language models, enabling the creation of draft models for speculative decoding WITHOUT retraining.☆48Updated 2 months ago
- Multi-Agent Step Race Benchmark: Assessing LLM Collaboration and Deception Under Pressure. A multi-player “step-race” that challenges LLM…☆85Updated last month
- An extension that lets the AI take the wheel, allowing it to use the mouse and keyboard, recognize UI elements, and prompt itself :3...no…☆127Updated last year
- ☆109Updated 5 months ago
- ☆165Updated 5 months ago
- ☆189Updated last year
- A benchmark for emotional intelligence in large language models☆397Updated last year
- Enhancing LLMs with LoRA☆206Updated 3 months ago
- Easily view and modify JSON datasets for large language models☆86Updated 8 months ago
- This benchmark tests how well LLMs incorporate a set of 10 mandatory story elements (characters, objects, core concepts, attributes, moti…☆331Updated last month
- A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.☆100Updated 6 months ago
- Serving LLMs in the HF-Transformers format via a PyFlask API☆72Updated last year
- ☆158Updated 9 months ago
- Function Calling Benchmark & Testing☆92Updated last year
- Conduct in-depth research with AI-driven insights : DeepDive is a command-line tool that leverages web searches and AI models to generate…☆44Updated last year
- Distributed Inference for mlx LLm☆100Updated last year
- A multi-player tournament benchmark that tests LLMs in social reasoning, strategy, and deception. Players engage in public and private co…☆296Updated 2 weeks ago
- Testing LLM reasoning abilities with lineage relationship quizzes.☆35Updated this week
- Smart proxy for LLM APIs that enables model-specific parameter control, automatic mode switching (like Qwen3's /think and /no_think), and…☆50Updated 8 months ago