nostalgebraist / transformer-utilsLinks
Utilities for the HuggingFace transformers library
☆73Updated 2 years ago
Alternatives and similar repositories for transformer-utils
Users that are interested in transformer-utils are comparing it to the libraries listed below
Sorting:
- Mechanistic Interpretability for Transformer Models☆53Updated 3 years ago
- Erasing concepts from neural representations with provable guarantees☆242Updated 11 months ago
- ☆132Updated 2 years ago
- ☆56Updated 2 years ago
- A library for efficient patching and automatic circuit discovery.☆84Updated 5 months ago
- The official code of LM-Debugger, an interactive tool for inspection and intervention in transformer-based language models.☆180Updated 3 years ago
- Emergent world representations: Exploring a sequence model trained on a synthetic task☆197Updated 2 years ago
- Mechanistic Interpretability Visualizations using React☆303Updated last year
- ☆134Updated last year
- A library to create and manage configuration files, especially for machine learning projects.☆79Updated 3 years ago
- Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).☆233Updated last year
- A library for finding knowledge neurons in pretrained transformer models.☆158Updated 3 years ago
- Sparse Autoencoder Training Library☆56Updated 7 months ago
- ☆283Updated last year
- Simple and scalable tools for data-driven pretraining data selection.☆29Updated 6 months ago
- Notebooks accompanying Anthropic's "Toy Models of Superposition" paper☆131Updated 3 years ago
- Investigating the generalization behavior of LM probes trained to predict truth labels: (1) from one annotator to another, and (2) from e…☆28Updated last year
- The accompanying code for "Transformer Feed-Forward Layers Are Key-Value Memories". Mor Geva, Roei Schuster, Jonathan Berant, and Omer Le…☆99Updated 4 years ago
- Keeping language models honest by directly eliciting knowledge encoded in their activations.☆216Updated last week
- CausalGym: Benchmarking causal interpretability methods on linguistic tasks☆51Updated last year
- PAIR.withgoogle.com and friend's work on interpretability methods☆215Updated last month
- ☆36Updated 2 years ago
- ☆32Updated 10 months ago
- Code and Data Repo for the CoNLL Paper -- Future Lens: Anticipating Subsequent Tokens from a Single Hidden State☆20Updated 2 months ago
- ☆261Updated last year
- Sparse probing paper full code.☆66Updated 2 years ago
- [NeurIPS 2023] Learning Transformer Programs☆162Updated last year
- Extract full next-token probabilities via language model APIs☆248Updated last year
- Tools for understanding how transformer predictions are built layer-by-layer☆555Updated 4 months ago
- NeuroSurgeon is a package that enables researchers to uncover and manipulate subnetworks within models in Huggingface Transformers☆42Updated 10 months ago