aidanmclaughlin / AidanBenchLinks
Aidan Bench attempts to measure <big_model_smell> in LLMs.
☆315Updated 5 months ago
Alternatives and similar repositories for AidanBench
Users that are interested in AidanBench are comparing it to the libraries listed below
Sorting:
- A comprehensive repository of reasoning tasks for LLMs (and beyond)☆452Updated last year
- smol models are fun too☆92Updated last year
- Simple Transformer in Jax☆139Updated last year
- Draw more samples☆195Updated last year
- A Loom implementation in Obsidian☆313Updated 8 months ago
- Worker to orchestrate and manage running an arbitrary number of LLM-generated builds concurrently using containerized Minecraft Servers.☆166Updated last year
- Plotting (entropy, varentropy) for small LMs☆99Updated 6 months ago
- smolLM with Entropix sampler on pytorch☆149Updated last year
- ☆129Updated 11 months ago
- Testing baseline LLMs performance across various models☆325Updated last week
- MiniHF is an inference, human preference data collection, and fine-tuning tool for local language models. It is intended to help the user…☆182Updated last month
- The history files when recording human interaction while solving ARC tasks☆118Updated 3 weeks ago
- ☆179Updated 11 months ago
- Atropos is a Language Model Reinforcement Learning Environments framework for collecting and evaluating LLM trajectories through diverse …☆760Updated this week
- ☆108Updated 2 weeks ago
- ComplexTensor: Machine Learning By Bridging Classical and Quantum Computation☆79Updated last year
- Fast parallel LLM inference for MLX☆234Updated last year
- This repository allows reproduction of Poetiq's record-breaking submission to the ARC-AGI-1 and ARC-AGI-2 benchmarks.☆366Updated this week
- ☆92Updated last year
- ☆331Updated 4 months ago
- PageRank for LLMs☆51Updated 2 months ago
- Claude Deep Research config for Claude Code.☆223Updated 8 months ago
- Long context evaluation for large language models☆224Updated 9 months ago
- This repository explains and provides examples for "concept anchoring" in GPT4.☆71Updated last year
- A library for making RepE control vectors☆668Updated 2 months ago
- Training-Ready RL Environments + Evals☆185Updated this week
- Inference-time scaling for LLMs-as-a-judge.☆314Updated last month
- A graph visualization of attention☆57Updated 6 months ago
- Vivaria is METR's tool for running evaluations and conducting agent elicitation research.☆120Updated 3 weeks ago
- explore token trajectory trees on instruct and base models☆149Updated 6 months ago