aidanmclaughlin / AidanBenchLinks
Aidan Bench attempts to measure <big_model_smell> in LLMs.
☆312Updated 4 months ago
Alternatives and similar repositories for AidanBench
Users that are interested in AidanBench are comparing it to the libraries listed below
Sorting:
- A comprehensive repository of reasoning tasks for LLMs (and beyond)☆450Updated last year
- smol models are fun too☆93Updated 11 months ago
- ☆170Updated 10 months ago
- Draw more samples☆194Updated last year
- MiniHF is an inference, human preference data collection, and fine-tuning tool for local language models. It is intended to help the user…☆181Updated 2 weeks ago
- Plotting (entropy, varentropy) for small LMs☆98Updated 5 months ago
- Testing baseline LLMs performance across various models☆319Updated 2 weeks ago
- A Loom implementation in Obsidian☆311Updated 7 months ago
- Simple Transformer in Jax☆139Updated last year
- The history files when recording human interaction while solving ARC tasks☆117Updated 2 weeks ago
- ☆104Updated last week
- ☆124Updated 10 months ago
- smolLM with Entropix sampler on pytorch☆150Updated 11 months ago
- Atropos is a Language Model Reinforcement Learning Environments framework for collecting and evaluating LLM trajectories through diverse …☆726Updated last week
- Vivaria is METR's tool for running evaluations and conducting agent elicitation research.☆116Updated this week
- Open source interpretability artefacts for R1.☆163Updated 6 months ago
- Fast parallel LLM inference for MLX☆224Updated last year
- Long context evaluation for large language models☆224Updated 7 months ago
- Inference-time scaling for LLMs-as-a-judge.☆304Updated 3 weeks ago
- A library for making RepE control vectors☆651Updated last month
- Training-Ready RL Environments + Evals☆132Updated this week
- This repository explains and provides examples for "concept anchoring" in GPT4.☆71Updated last year
- ☆319Updated 3 months ago
- ⚖️ Awesome LLM Judges ⚖️☆132Updated 6 months ago
- METR Task Standard☆163Updated 8 months ago
- Approximation of the Claude 3 tokenizer by inspecting generation stream☆142Updated last year
- Worker to orchestrate and manage running an arbitrary number of LLM-generated builds concurrently using containerized Minecraft Servers.☆166Updated 10 months ago
- ☆123Updated last year
- A benchmark for emotional intelligence in large language models☆369Updated last year
- Claude Deep Research config for Claude Code.☆223Updated 7 months ago