ArthurConmy / MishformerLensLinks
MishformerLens intends to be a drop-in replacement for TransformerLens that AST patches HuggingFace Transformers rather than implementing a custom, numerically inaccurate Transformer architecture.
☆10Updated last year
Alternatives and similar repositories for MishformerLens
Users that are interested in MishformerLens are comparing it to the libraries listed below
Sorting:
- PyTorch and NNsight implementation of AtP* (Kramar et al 2024, DeepMind)☆20Updated 10 months ago
- A tiny easily hackable implementation of a feature dashboard.☆15Updated last month
- Sparse Autoencoder Training Library☆55Updated 7 months ago
- Engine for collecting, uploading, and downloading model activations☆24Updated 8 months ago
- Steering vectors for transformer language models in Pytorch / Huggingface☆130Updated 9 months ago
- A library for efficient patching and automatic circuit discovery.☆80Updated 4 months ago
- Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).☆231Updated 11 months ago
- Erasing concepts from neural representations with provable guarantees☆239Updated 10 months ago
- Delphi was the home of a temple to Phoebus Apollo, which famously had the inscription, 'Know Thyself.' This library lets language models …☆228Updated last week
- Code for my NeurIPS 2024 ATTRIB paper titled "Attribution Patching Outperforms Automated Circuit Discovery"☆43Updated last year
- graphpatch is a library for activation patching on PyTorch neural network models.☆20Updated 9 months ago
- ☆132Updated 2 years ago
- How do transformer LMs encode relations?☆57Updated last year
- Mechanistic Interpretability Visualizations using React☆302Updated 11 months ago
- Utilities for the HuggingFace transformers library☆72Updated 2 years ago
- ☆63Updated 4 months ago
- Unified access to Large Language Model modules using NNsight☆63Updated 2 weeks ago
- Attribution-based Parameter Decomposition☆32Updated 5 months ago
- A python sdk for LLM finetuning and inference on runpod infrastructure☆16Updated 3 weeks ago
- ☆19Updated 7 months ago
- ☆15Updated 4 months ago
- ☆258Updated last year
- ☆111Updated 9 months ago
- ☆83Updated 9 months ago
- ☆283Updated last year
- ☆36Updated last year
- A toolkit for describing model features and intervening on those features to steer behavior.☆216Updated last year
- Code for reproducing our paper "Not All Language Model Features Are Linear"☆84Updated last year
- A library for training crosscoders☆13Updated 6 months ago
- Steering Llama 2 with Contrastive Activation Addition☆195Updated last year