ArthurConmy / MishformerLens
MishformerLens intends to be a drop-in replacement for TransformerLens that AST patches HuggingFace Transformers rather than implementing a custom, numerically inaccurate Transformer architecture.
☆10Updated 7 months ago
Alternatives and similar repositories for MishformerLens
Users that are interested in MishformerLens are comparing it to the libraries listed below
Sorting:
- Delphi was the home of a temple to Phoebus Apollo, which famously had the inscription, 'Know Thyself.' This library lets language models …☆172Updated this week
- PyTorch and NNsight implementation of AtP* (Kramar et al 2024, DeepMind)☆18Updated 3 months ago
- ☆33Updated 2 weeks ago
- A library for efficient patching and automatic circuit discovery.☆64Updated 3 weeks ago
- Sparse Autoencoder Training Library☆49Updated 2 weeks ago
- ☆27Updated last year
- A TinyStories LM with SAEs and transcoders☆11Updated last month
- Code for reproducing our paper "Not All Language Model Features Are Linear"☆74Updated 5 months ago
- ☆16Updated last week
- How do transformer LMs encode relations?☆48Updated last year
- Steering vectors for transformer language models in Pytorch / Huggingface☆100Updated 2 months ago
- Code for my NeurIPS 2024 ATTRIB paper titled "Attribution Patching Outperforms Automated Circuit Discovery"☆31Updated 11 months ago
- ☆112Updated 6 months ago
- Code and Data Repo for the CoNLL Paper -- Future Lens: Anticipating Subsequent Tokens from a Single Hidden State☆18Updated last year
- ☆12Updated last month
- ☆121Updated last year
- ☆223Updated 7 months ago
- ☆38Updated last week
- ☆132Updated 6 months ago
- ☆93Updated 3 months ago
- ☆93Updated last month
- This repository contains the code used for the experiments in the paper "Fine-Tuning Enhances Existing Mechanisms: A Case Study on Entity…☆25Updated last year
- graphpatch is a library for activation patching on PyTorch neural network models.☆14Updated 3 months ago
- Mechanistic Interpretability for Transformer Models☆50Updated 2 years ago
- Sparse probing paper full code.☆56Updated last year
- Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).☆201Updated 5 months ago
- Open source replication of Anthropic's Crosscoders for Model Diffing☆55Updated 6 months ago
- Algebraic value editing in pretrained language models☆65Updated last year
- ☆31Updated last year
- Applying SAEs for fine-grained control☆18Updated 5 months ago