UKGovernmentBEIS / control-arenaLinks
ControlArena is a suite of realistic settings, mimicking complex deployment environments, for running control evaluations. This is an alpha release; we welcome feedback.
☆69Updated this week
Alternatives and similar repositories for control-arena
Users that are interested in control-arena are comparing it to the libraries listed below
Sorting:
- METR Task Standard☆151Updated 4 months ago
- ☆66Updated last month
- Collection of evals for Inspect AI☆167Updated this week
- ☆227Updated 8 months ago
- Mechanistic Interpretability Visualizations using React☆257Updated 6 months ago
- Inference API for many LLMs and other useful tools for empirical research☆49Updated last week
- ☆55Updated 9 months ago
- Vivaria is METR's tool for running evaluations and conducting agent elicitation research.☆96Updated this week
- A library for efficient patching and automatic circuit discovery.☆67Updated 2 months ago
- Steering vectors for transformer language models in Pytorch / Huggingface☆108Updated 4 months ago
- ☆11Updated 11 months ago
- Tools for studying developmental interpretability in neural networks.☆95Updated this week
- ☆28Updated last year
- Delphi was the home of a temple to Phoebus Apollo, which famously had the inscription, 'Know Thyself.' This library lets language models …☆185Updated last week
- ☆134Updated 7 months ago
- (Model-written) LLM evals library☆18Updated 6 months ago
- Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).☆202Updated 6 months ago
- A toolkit for describing model features and intervening on those features to steer behavior.☆190Updated 7 months ago
- Contains random samples referenced in the paper "Sleeper Agents: Training Robustly Deceptive LLMs that Persist Through Safety Training".☆108Updated last year
- Improving Alignment and Robustness with Circuit Breakers☆214Updated 9 months ago
- ☆101Updated 3 weeks ago
- ☆99Updated 4 months ago
- Code for my NeurIPS 2024 ATTRIB paper titled "Attribution Patching Outperforms Automated Circuit Discovery"☆35Updated last year
- Steering Llama 2 with Contrastive Activation Addition☆158Updated last year
- LLM experiments done during SERI MATS - focusing on activation steering / interpreting activation spaces☆94Updated last year
- WMDP is a LLM proxy benchmark for hazardous knowledge in bio, cyber, and chemical security. We also release code for RMU, an unlearning m…☆127Updated 3 weeks ago
- ☆175Updated 2 months ago
- Using sparse coding to find distributed representations used by neural networks.☆255Updated last year
- 🧠 Starter templates for doing interpretability research☆71Updated last year
- Sparse Autoencoder for Mechanistic Interpretability☆252Updated 11 months ago