Inference API for many LLMs and other useful tools for empirical research
☆108Mar 2, 2026Updated last week
Alternatives and similar repositories for safety-tooling
Users that are interested in safety-tooling are comparing it to the libraries listed below
Sorting:
- ☆25Nov 11, 2025Updated 3 months ago
- ControlArena is a collection of settings, model organisms and protocols - for running control experiments.☆160Feb 27, 2026Updated last week
- A python sdk for LLM finetuning and inference on runpod infrastructure☆20Feb 16, 2026Updated 3 weeks ago
- ☆20May 25, 2024Updated last year
- Open source replication of Anthropic's Crosscoders for Model Diffing☆64Oct 27, 2024Updated last year
- Official codebase for "Analyzing the Generalization and Reliability of Steering Vectors"☆19Dec 14, 2024Updated last year
- Vivaria is METR's tool for running evaluations and conducting agent elicitation research.☆134Feb 15, 2026Updated 3 weeks ago
- Codebase for "On Targeted Manipulation and Deception when Optimizing LLMs for User Feedback". This repo implements a generative multi-tur…☆23Dec 3, 2024Updated last year
- A collection of different ways to implement accessing and modifying internal model activations for LLMs☆20Oct 18, 2024Updated last year
- Improving transparency of large language models' reasoning☆14Nov 25, 2025Updated 3 months ago
- Code for the "Overcoming Sparsity Artifacts in Crosscoders to Interpret Chat-Tuning" paper.☆16Nov 21, 2025Updated 3 months ago
- Multi-Layer Sparse Autoencoders (ICLR 2025)☆29Feb 6, 2026Updated last month
- Machine Learning for Alignment Bootcamp☆82Apr 27, 2022Updated 3 years ago
- ☆24Oct 3, 2025Updated 5 months ago
- Code to reproduce key results accompanying "SAEs (usually) Transfer Between Base and Chat Models"☆13Jul 18, 2024Updated last year
- Code for Tangent Model Composition for Ensembling and Continual Fine-tuning (ICCV 2023) and Tangent Transformers for Composition, Privacy…☆13May 14, 2024Updated last year
- ☆21Jun 22, 2025Updated 8 months ago
- A toolkit that provides a range of model diffing techniques including a UI to visualize them interactively.☆66Updated this week
- Attribution-based Parameter Decomposition☆34Jun 11, 2025Updated 8 months ago
- Shaping capabilities with token-level pretraining data filtering☆84Jan 28, 2026Updated last month
- ☆22Feb 13, 2026Updated 3 weeks ago
- A TinyStories LM with SAEs and transcoders☆14Apr 3, 2025Updated 11 months ago
- Learning Safety Constraints for Large Language Models (ICML2025)☆31Aug 4, 2025Updated 7 months ago
- A benchmark for mechanistic discovery of circuits in Transformers☆16Dec 15, 2024Updated last year
- ☆36May 9, 2025Updated 10 months ago
- An alignment auditing agent capable of quickly exploring alignment hypothesis☆934Feb 28, 2026Updated last week
- Code for my NeurIPS 2024 ATTRIB paper titled "Attribution Patching Outperforms Automated Circuit Discovery"☆47May 31, 2024Updated last year
- Automatically create Anki cards from text using language models☆20Jan 7, 2023Updated 3 years ago
- The nnsight package enables interpreting and manipulating the internals of deep learned models.☆836Updated this week
- ☆89Dec 18, 2025Updated 2 months ago
- ☆75Feb 18, 2026Updated 2 weeks ago
- ☆979Updated this week
- Implementation of Influence Function approximations for differently sized ML models, using PyTorch☆16Sep 15, 2023Updated 2 years ago
- ✨ Monorepo containing most of BlueDot Impact's custom software.☆24Mar 3, 2026Updated last week
- ☆18Feb 25, 2026Updated last week
- A library for efficient patching and automatic circuit discovery.☆91Dec 31, 2025Updated 2 months ago
- Code for "On Measuring Faithfulness of Natural Language Explanations"☆21Jul 23, 2024Updated last year
- PyTorch and NNsight implementation of AtP* (Kramar et al 2024, DeepMind)☆20Jan 19, 2025Updated last year
- Implementation of Direct Preference Optimization☆17Jul 17, 2023Updated 2 years ago