aidanmclaughlin / AidanBenchLinks
Aidan Bench attempts to measure <big_model_smell> in LLMs.
☆318Updated 7 months ago
Alternatives and similar repositories for AidanBench
Users that are interested in AidanBench are comparing it to the libraries listed below
Sorting:
- smol models are fun too☆93Updated last year
- A comprehensive repository of reasoning tasks for LLMs (and beyond)☆458Updated last year
- Plotting (entropy, varentropy) for small LMs☆99Updated 8 months ago
- smolLM with Entropix sampler on pytorch☆149Updated last year
- A Loom implementation in Obsidian☆324Updated 10 months ago
- Simple Transformer in Jax☆142Updated last year
- Testing baseline LLMs performance across various models☆336Updated last week
- ☆118Updated 3 weeks ago
- ☆134Updated last year
- MiniHF is an inference, human preference data collection, and fine-tuning tool for local language models. It is intended to help the user…☆183Updated 3 months ago
- The history files when recording human interaction while solving ARC tasks☆117Updated 2 weeks ago
- Draw more samples☆198Updated last year
- Long context evaluation for large language models☆226Updated 11 months ago
- Atropos is a Language Model Reinforcement Learning Environments framework for collecting and evaluating LLM trajectories through diverse …☆853Updated this week
- A library for making RepE control vectors☆685Updated 4 months ago
- ComplexTensor: Machine Learning By Bridging Classical and Quantum Computation☆78Updated last year
- ☆190Updated last year
- Fast parallel LLM inference for MLX☆246Updated last year
- Inference-time scaling for LLMs-as-a-judge.☆328Updated 3 months ago
- A graph visualization of attention☆57Updated 8 months ago
- Worker to orchestrate and manage running an arbitrary number of LLM-generated builds concurrently using containerized Minecraft Servers.☆168Updated last year
- Claude Deep Research config for Claude Code.☆226Updated 10 months ago
- Open source interpretability artefacts for R1.☆170Updated 9 months ago
- PageRank for LLMs☆52Updated 5 months ago
- Vivaria is METR's tool for running evaluations and conducting agent elicitation research.☆134Updated this week
- look how they massacred my boy☆63Updated last year
- ☆162Updated last year
- ☆137Updated 10 months ago
- Lightly-reviewed collection of community environments☆210Updated 2 weeks ago
- METR Task Standard☆173Updated last year