multimodal-interpretability / FINDLinks
Official implementation of FIND (NeurIPS '23) Function Interpretation Benchmark and Automated Interpretability Agents
☆51Updated last year
Alternatives and similar repositories for FIND
Users that are interested in FIND are comparing it to the libraries listed below
Sorting:
- Sparse and discrete interpretability tool for neural networks☆64Updated last year
- ☆100Updated last year
- Online Adaptation of Language Models with a Memory of Amortized Contexts (NeurIPS 2024)☆70Updated last year
- ☆110Updated 9 months ago
- PyTorch library for Active Fine-Tuning☆95Updated last month
- Code for reproducing our paper "Not All Language Model Features Are Linear"☆84Updated 11 months ago
- ☆105Updated last year
- ☆29Updated last month
- Advantage Leftover Lunch Reinforcement Learning (A-LoL RL): Improving Language Models with Advantage-based Offline Policy Gradients☆26Updated last year
- This is code for most of the experiments in the paper Understanding the Effects of RLHF on LLM Generalisation and Diversity☆47Updated last year
- Language models scale reliably with over-training and on downstream tasks☆100Updated last year
- Official implementation of MAIA, A Multimodal Automated Interpretability Agent☆97Updated 3 weeks ago
- ☆111Updated 9 months ago
- ☆85Updated last year
- ☆104Updated last year
- Code for the ICLR 2024 paper "How to catch an AI liar: Lie detection in black-box LLMs by asking unrelated questions"☆71Updated last year
- Official repository for our paper, Transformers Learn Higher-Order Optimization Methods for In-Context Learning: A Study with Linear Mode…☆19Updated last year
- Implementation of the BatchTopK activation function for training sparse autoencoders (SAEs)☆54Updated 3 months ago
- ☆27Updated 2 years ago
- Public code release for the paper "Reawakening knowledge: Anticipatory recovery from catastrophic interference via structured training"☆10Updated 3 weeks ago
- A mechanistic approach for understanding and detecting factual errors of large language models.☆47Updated last year
- RL algorithm: Advantage induced policy alignment☆65Updated 2 years ago
- [NeurIPS 2023] Learning Transformer Programs☆162Updated last year
- Function Vectors in Large Language Models (ICLR 2024)☆184Updated 7 months ago
- Code release for "Debating with More Persuasive LLMs Leads to More Truthful Answers"☆121Updated last year
- Repo for: When to Make Exceptions: Exploring Language Models as Accounts of Human Moral Judgment☆38Updated 2 years ago
- Code for PHATGOOSE introduced in "Learning to Route Among Specialized Experts for Zero-Shot Generalization"☆91Updated last year
- 👻 Code and benchmark for our EMNLP 2023 paper - "FANToM: A Benchmark for Stress-testing Machine Theory of Mind in Interactions"☆56Updated last year
- [ACL 2023] Gradient Ascent Post-training Enhances Language Model Generalization☆28Updated last year
- Yet another random morning idea to be quickly tried and architecture shared if it works; to allow the transformer to pause for any amount…☆52Updated 2 years ago