mechanistic-interpretability-grokking / progress-measures-paper
☆58Updated 2 years ago
Alternatives and similar repositories for progress-measures-paper:
Users that are interested in progress-measures-paper are comparing it to the libraries listed below
- ☆106Updated 5 months ago
- ☆114Updated last year
- Sparse Autoencoder Training Library☆38Updated 2 months ago
- ☆82Updated 11 months ago
- Experiments and code to generate the GINC small-scale in-context learning dataset from "An Explanation for In-context Learning as Implici…☆100Updated last year
- ☆201Updated 3 months ago
- Notebooks accompanying Anthropic's "Toy Models of Superposition" paper☆108Updated 2 years ago
- ☆53Updated 2 months ago
- Sparse and discrete interpretability tool for neural networks☆58Updated 11 months ago
- ☆75Updated 5 months ago
- Code Release for "Broken Neural Scaling Laws" (BNSL) paper☆57Updated last year
- A library for efficient patching and automatic circuit discovery.☆46Updated last month
- The accompanying code for "Transformer Feed-Forward Layers Are Key-Value Memories". Mor Geva, Roei Schuster, Jonathan Berant, and Omer Le…☆89Updated 3 years ago
- Mechanistic Interpretability for Transformer Models☆49Updated 2 years ago
- ☆51Updated 7 months ago
- Sparse probing paper full code.☆53Updated last year
- ☆41Updated this week
- How do transformer LMs encode relations?☆46Updated 10 months ago
- ☆26Updated last year
- Using sparse coding to find distributed representations used by neural networks.☆207Updated last year
- Inspecting and Editing Knowledge Representations in Language Models☆111Updated last year
- Algebraic value editing in pretrained language models☆62Updated last year
- Code for my NeurIPS 2024 ATTRIB paper titled "Attribution Patching Outperforms Automated Circuit Discovery"☆27Updated 7 months ago
- ☆17Updated last month
- nanoGPT-like codebase for LLM training☆83Updated this week
- ☆131Updated 3 months ago
- Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).☆176Updated last month
- unofficial re-implementation of "Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets"☆67Updated 2 years ago
- This repository includes code for the paper "Does Localization Inform Editing? Surprising Differences in Where Knowledge Is Stored vs. Ca…☆58Updated last year
- Steering Llama 2 with Contrastive Activation Addition☆113Updated 7 months ago