cpldcpu / MisguidedAttentionLinks
A collection of prompts to challenge the reasoning abilities of large language models in presence of misguiding information
☆452Updated 3 months ago
Alternatives and similar repositories for MisguidedAttention
Users that are interested in MisguidedAttention are comparing it to the libraries listed below
Sorting:
- ☆135Updated 6 months ago
- ☆326Updated 3 months ago
- Comparison of the output quality of quantization methods, using Llama 3, transformers, GGUF, EXL2.☆165Updated last year
- A benchmark for emotional intelligence in large language models☆382Updated last year
- Simple Python library/structure to ablate features in LLMs which are supported by TransformerLens☆530Updated last year
- Fast parallel LLM inference for MLX☆232Updated last year
- A comprehensive repository of reasoning tasks for LLMs (and beyond)☆450Updated last year
- A multi-player tournament benchmark that tests LLMs in social reasoning, strategy, and deception. Players engage in public and private co…☆293Updated 3 months ago
- ☆174Updated 11 months ago
- AI management tool☆121Updated last year
- Hallucinations (Confabulations) Document-Based Benchmark for RAG. Includes human-verified questions and answers.☆236Updated 3 months ago
- Official repository for "NoLiMa: Long-Context Evaluation Beyond Literal Matching"☆166Updated 4 months ago
- Official repository for "DynaSaur: Large Language Agents Beyond Predefined Actions"☆348Updated 11 months ago
- Guaranteed Structured Output from any Language Model via Hierarchical State Machines☆145Updated last month
- Generate Synthetic Data Using OpenAI, MistralAI or AnthropicAI☆221Updated last year
- Dataset Crafting w/ RAG/Wikipedia ground truth and Efficient Fine-Tuning Using MLX and Unsloth. Includes configurable dataset annotation …☆190Updated last year
- klmbr - a prompt pre-processing technique to break through the barrier of entropy while generating text with LLMs☆84Updated last year
- This project demonstrates a basic chain-of-thought interaction with any LLM (Large Language Model)☆323Updated last year
- Multi-Agent Step Race Benchmark: Assessing LLM Collaboration and Deception Under Pressure. A multi-player “step-race” that challenges LLM…☆76Updated 2 months ago
- A compact LLM pretrained in 9 days by using high quality data☆334Updated 7 months ago
- function calling-based LLM agents☆289Updated last year
- An easy-to-understand framework for LLM samplers that rewind and revise generated tokens☆145Updated 9 months ago
- 🤗 Benchmark Large Language Models Reliably On Your Data☆411Updated this week
- A multimodal, function calling powered LLM webui.☆217Updated last year
- This benchmark tests how well LLMs incorporate a set of 10 mandatory story elements (characters, objects, core concepts, attributes, moti…☆316Updated 2 months ago
- Aidan Bench attempts to measure <big_model_smell> in LLMs.☆315Updated 4 months ago
- ☆163Updated 3 months ago
- This is our own implementation of 'Layer Selective Rank Reduction'☆239Updated last year
- Create an open source toy dataset for finetuning LLMs with reasoning abilities☆417Updated last year
- Testing baseline LLMs performance across various models☆322Updated last week