ArthurConmy / MishformerLens
MishformerLens intends to be a drop-in replacement for TransformerLens that AST patches HuggingFace Transformers rather than implementing a custom, numerically inaccurate Transformer architecture.
☆11Updated 3 months ago
Alternatives and similar repositories for MishformerLens:
Users that are interested in MishformerLens are comparing it to the libraries listed below
- ☆53Updated 2 months ago
- ☆135Updated this week
- Steering vectors for transformer language models in Pytorch / Huggingface☆78Updated last month
- PyTorch and NNsight implementation of AtP* (Kramar et al 2024, DeepMind)☆18Updated 9 months ago
- Code and Data Repo for the CoNLL Paper -- Future Lens: Anticipating Subsequent Tokens from a Single Hidden State☆18Updated last year
- Sparse Autoencoder Training Library☆38Updated 2 months ago
- Code for reproducing our paper "Not All Language Model Features Are Linear"☆65Updated last month
- This repository contains the code used for the experiments in the paper "Fine-Tuning Enhances Existing Mechanisms: A Case Study on Entity…☆21Updated 9 months ago
- How do transformer LMs encode relations?☆46Updated 10 months ago
- ☆114Updated last year
- Steering Llama 2 with Contrastive Activation Addition☆114Updated 7 months ago
- ☆25Updated 9 months ago
- Monet: Mixture of Monosemantic Experts for Transformers☆44Updated this week
- Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).☆176Updated last month
- Open source replication of Anthropic's Crosscoders for Model Diffing☆28Updated 2 months ago
- Code for my NeurIPS 2024 ATTRIB paper titled "Attribution Patching Outperforms Automated Circuit Discovery"☆27Updated 7 months ago
- Repository for the code of the "PPL-MCTS: Constrained Textual Generation Through Discriminator-Guided Decoding" paper, NAACL'22☆65Updated 2 years ago
- ☆115Updated this week
- ☆82Updated 11 months ago
- ☆21Updated 2 months ago
- ☆79Updated last week
- ☆75Updated 5 months ago
- A library for efficient patching and automatic circuit discovery.☆46Updated last month
- General-purpose activation steering library☆41Updated 2 weeks ago
- ☆25Updated 2 months ago
- The simplest, fastest repository for training/finetuning medium-sized GPTs.☆90Updated 2 months ago
- Algebraic value editing in pretrained language models☆62Updated last year
- ☆11Updated this week
- Code for Zero-Shot Tokenizer Transfer☆120Updated this week
- Mechanistic Interpretability Visualizations using React☆220Updated last month