lechmazur / nyt-connectionsLinks
Benchmark that evaluates LLMs using 759 NYT Connections puzzles extended with extra trick words
☆147Updated 3 weeks ago
Alternatives and similar repositories for nyt-connections
Users that are interested in nyt-connections are comparing it to the libraries listed below
Sorting:
- Pivotal Token Search☆127Updated 2 months ago
- ☆104Updated 3 months ago
- Hallucinations (Confabulations) Document-Based Benchmark for RAG. Includes human-verified questions and answers.☆229Updated 2 months ago
- Thematic Generalization Benchmark: measures how effectively various LLMs can infer a narrow or specific "theme" (category/rule) from a sm…☆63Updated 2 weeks ago
- A multi-player tournament benchmark that tests LLMs in social reasoning, strategy, and deception. Players engage in public and private co…☆290Updated last month
- An easy-to-understand framework for LLM samplers that rewind and revise generated tokens☆145Updated 7 months ago
- klmbr - a prompt pre-processing technique to break through the barrier of entropy while generating text with LLMs☆79Updated last year
- LLM Divergent Thinking Creativity Benchmark. LLMs generate 25 unique words that start with a given letter with no connections to each oth…☆32Updated 6 months ago
- Guaranteed Structured Output from any Language Model via Hierarchical State Machines☆145Updated this week
- SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?☆181Updated last week
- explore token trajectory trees on instruct and base models☆133Updated 4 months ago
- Conduct in-depth research with AI-driven insights : DeepDive is a command-line tool that leverages web searches and AI models to generate…☆42Updated last year
- ☆270Updated 4 months ago
- Glyphs, acting as collaboratively defined symbols linking related concepts, add a layer of multidimensional semantic richness to user-AI …☆51Updated 8 months ago
- Clue inspired puzzles for testing LLM deduction abilities☆43Updated 6 months ago
- Multi-Agent Step Race Benchmark: Assessing LLM Collaboration and Deception Under Pressure. A multi-player “step-race” that challenges LLM…☆73Updated last month
- Benchmark evaluating LLMs on their ability to create and resist disinformation. Includes comprehensive testing across major models (Claud…☆29Updated 6 months ago
- AI management tool☆121Updated 11 months ago
- Public Goods Game (PGG) Benchmark: Contribute & Punish is a multi-agent benchmark that tests cooperative and self-interested strategies a…☆39Updated 6 months ago
- A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.☆96Updated 3 months ago
- Smart proxy for LLM APIs that enables model-specific parameter control, automatic mode switching (like Qwen3's /think and /no_think), and…☆50Updated 4 months ago
- Official homepage for "Self-Harmonized Chain of Thought" (NAACL 2025)☆91Updated 8 months ago
- A preprint version of our recent research on the capability of frontier AI systems to do self-replication☆57Updated 9 months ago
- A simple experiment on letting two local LLM have a conversation about anything!☆111Updated last year
- ☆134Updated 5 months ago
- look how they massacred my boy☆63Updated 11 months ago
- a lightweight, open-source blueprint for building powerful and scalable LLM chat applications☆28Updated last year
- Useful resources for LLM-based Diarization and Transcription.☆54Updated 11 months ago
- Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…☆80Updated last week
- Alice in Wonderland code base for experiments and raw experiments data☆131Updated 3 weeks ago