Benchmark that evaluates LLMs using 759 NYT Connections puzzles extended with extra trick words
☆199Mar 6, 2026Updated 2 weeks ago
Alternatives and similar repositories for nyt-connections
Users that are interested in nyt-connections are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Multi-Agent Step Race Benchmark: Assessing LLM Collaboration and Deception Under Pressure. A multi-player “step-race” that challenges LLM…☆84Dec 9, 2025Updated 3 months ago
- LLM Divergent Thinking Creativity Benchmark. LLMs generate 25 unique words that start with a given letter with no connections to each oth…☆34Mar 20, 2025Updated last year
- A multi-player tournament benchmark that tests LLMs in social reasoning, strategy, and deception. Players engage in public and private co…☆301Jan 7, 2026Updated 2 months ago
- Benchmark evaluating LLMs on their ability to create and resist disinformation. Includes comprehensive testing across major models (Claud…☆31Mar 20, 2025Updated last year
- This benchmark tests how well LLMs incorporate a set of 10 mandatory story elements (characters, objects, core concepts, attributes, moti…☆355Feb 6, 2026Updated last month
- A benchmark for conversational bargaining by language models. In each 20‑round match one LLM plays buyer, one plays seller, and both hold…☆33Aug 21, 2025Updated 7 months ago
- The BAZAAR challenges LLMs to navigate the double-auction marketplace, where buyers and sellers must make strategic decisions with incomp…☆35Jul 30, 2025Updated 7 months ago
- Estimate the number of legal chess positions☆13Jan 14, 2021Updated 5 years ago
- Hallucinations (Confabulations) Document-Based Benchmark for RAG. Includes human-verified questions and answers.☆243Aug 7, 2025Updated 7 months ago
- Docker/podman container for llama.cpp/vllm/exllamav{2,3} orchestrated using llama-swap☆18Updated this week
- OpenPipe Reinforcement Learning Experiments☆32Mar 14, 2025Updated last year
- Yet another frontend for LLM, written using .NET and WinUI 3☆10Sep 14, 2025Updated 6 months ago
- ☆33Oct 26, 2025Updated 4 months ago
- A simple unified framework for evaluating LLMs☆266Apr 14, 2025Updated 11 months ago
- A toy Inspect implementation of the Bliss Attractor eval from Claude 4 System Card Welfare Assessment☆38Jun 5, 2025Updated 9 months ago
- A reverse proxy manager written in go, to convert exposed ports into token-based auth protected ports☆20Apr 14, 2025Updated 11 months ago
- Various LLM Benchmarks☆24Feb 20, 2026Updated last month
- ☆13Mar 11, 2018Updated 8 years ago
- Comprehensive LLM evaluation framework: GPQA Diamond to Chatbot Arena. Tests all major models equally, easily extensible.☆17Aug 22, 2024Updated last year
- DevQualityEval: An evaluation benchmark 📈 and framework to compare and evolve the quality of code generation of LLMs.☆184May 15, 2025Updated 10 months ago
- ☆15Feb 1, 2025Updated last year
- A lightweight API that returns Nvidia GPU utilisation information.☆16Sep 23, 2025Updated 6 months ago
- Implementation of Spectral State Space Models☆16Feb 23, 2024Updated 2 years ago
- openweb UI scripts☆12Jan 27, 2026Updated last month
- A simple external application for Windows that allows you to scan an existing custom_nodes directory and generate a list of the nodes ins…☆20Jul 6, 2025Updated 8 months ago
- ☆20Nov 5, 2024Updated last year
- CLaMR: Contextualized Late-Interaction for Multimodal Content Retrieval☆24Jun 28, 2025Updated 8 months ago
- Visualizing the internal board state of a GPT trained on chess PGN strings, and performing interventions on its internal board state and …☆217Nov 18, 2024Updated last year
- LiveBench: A Challenging, Contamination-Free LLM Benchmark☆1,100Mar 13, 2026Updated last week
- Grokking on modular arithmetic in less than 150 epochs in MLX☆16Oct 24, 2024Updated last year
- Enhancing Retrieval and Managing Retrieval: 4-Module Synergy☆23Dec 7, 2024Updated last year
- ☆135May 2, 2025Updated 10 months ago
- Simple examples using Argilla tools to build AI☆57Nov 18, 2024Updated last year
- Measuring Thinking Efficiency in Reasoning Models - Research Repository☆39Dec 2, 2025Updated 3 months ago
- ☆229May 7, 2025Updated 10 months ago
- Test your local LLMs on the AIME problems☆32Jun 7, 2025Updated 9 months ago
- Perl 5 Metaconfig☆16Feb 12, 2026Updated last month
- Experimental LLM Inference UX to aid in creative writing☆128Dec 14, 2024Updated last year
- Towards LLM Empowered Recommendation via Tool Learning☆23Aug 8, 2025Updated 7 months ago