lechmazur / confabulationsLinks
Hallucinations (Confabulations) Document-Based Benchmark for RAG. Includes human-verified questions and answers.
☆197Updated this week
Alternatives and similar repositories for confabulations
Users that are interested in confabulations are comparing it to the libraries listed below
Sorting:
- ☆133Updated 3 months ago
- An easy-to-understand framework for LLM samplers that rewind and revise generated tokens☆146Updated 5 months ago
- Benchmark that evaluates LLMs using 651 NYT Connections puzzles extended with extra trick words☆136Updated this week
- Guaranteed Structured Output from any Language Model via Hierarchical State Machines☆142Updated 2 months ago
- ☆312Updated last week
- klmbr - a prompt pre-processing technique to break through the barrier of entropy while generating text with LLMs☆80Updated 10 months ago
- AI management tool☆118Updated 9 months ago
- Generate Synthetic Data Using OpenAI, MistralAI or AnthropicAI☆222Updated last year
- Transplants vocabulary between language models, enabling the creation of draft models for speculative decoding WITHOUT retraining.☆41Updated 3 weeks ago
- ☆95Updated 7 months ago
- Multi-Agent Step Race Benchmark: Assessing LLM Collaboration and Deception Under Pressure. A multi-player “step-race” that challenges LLM…☆56Updated 3 weeks ago
- ☆155Updated 3 months ago
- Distributed Inference for mlx LLm☆94Updated last year
- ☆208Updated 3 weeks ago
- Easily view and modify JSON datasets for large language models☆81Updated 2 months ago
- This benchmark tests how well LLMs incorporate a set of 10 mandatory story elements (characters, objects, core concepts, attributes, moti…☆276Updated this week
- A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.☆90Updated last month
- ☆226Updated 2 months ago
- ☆102Updated last month
- ☆157Updated last year
- A benchmark for emotional intelligence in large language models☆336Updated last year
- DevQualityEval: An evaluation benchmark 📈 and framework to compare and evolve the quality of code generation of LLMs.☆179Updated 2 months ago
- Smart proxy for LLM APIs that enables model-specific parameter control, automatic mode switching (like Qwen3's /think and /no_think), and…☆49Updated 2 months ago
- Serving LLMs in the HF-Transformers format via a PyFlask API☆71Updated 11 months ago
- ☆146Updated 7 months ago
- A simple tool that let's you explore different possible paths that an LLM might sample.☆180Updated 3 months ago
- Fast parallel LLM inference for MLX☆206Updated last year
- Official repository for "DynaSaur: Large Language Agents Beyond Predefined Actions"☆347Updated 7 months ago
- Thematic Generalization Benchmark: measures how effectively various LLMs can infer a narrow or specific "theme" (category/rule) from a sm…☆63Updated this week
- ☆224Updated 5 months ago