neelnanda-io / Grokking
A Mechanistic Interpretability Analysis of Grokking
☆19Updated 2 years ago
Alternatives and similar repositories for Grokking:
Users that are interested in Grokking are comparing it to the libraries listed below
- unofficial re-implementation of "Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets"☆67Updated 2 years ago
- ☆25Updated 9 months ago
- Mechanistic Interpretability for Transformer Models☆49Updated 2 years ago
- ☆114Updated last year
- ☆53Updated 2 months ago
- Sparse and discrete interpretability tool for neural networks☆58Updated 11 months ago
- Omnigrok: Grokking Beyond Algorithmic Data☆51Updated last year
- ☆26Updated last year
- Code associated to papers on superposition (in ML interpretability)☆26Updated 2 years ago
- Open source replication of Anthropic's Crosscoders for Model Diffing☆28Updated 2 months ago
- Universal Neurons in GPT2 Language Models☆27Updated 7 months ago
- A MAD laboratory to improve AI architecture designs 🧪☆102Updated last month
- Implementation of OpenAI's 'Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets' paper.☆35Updated last year
- Tools for studying developmental interpretability in neural networks.☆82Updated last month
- 🧠 Starter templates for doing interpretability research☆64Updated last year
- ☆24Updated this week
- Investigating the generalization behavior of LM probes trained to predict truth labels: (1) from one annotator to another, and (2) from e…☆26Updated 7 months ago
- we got you bro☆33Updated 5 months ago
- gzip Predicts Data-dependent Scaling Laws☆33Updated 7 months ago
- A library for bridging Python and HTML/Javascript (via Svelte) for creating interactive visualizations☆14Updated 9 months ago
- ☆48Updated 3 months ago
- ☆51Updated 7 months ago
- Accompanying codebase for neuroscope.io, a website for displaying max activating dataset examples for language model neurons☆11Updated last year
- Redwood Research's transformer interpretability tools☆13Updated 2 years ago
- ☆19Updated last year
- Notebooks accompanying Anthropic's "Toy Models of Superposition" paper☆108Updated 2 years ago
- Mechanistic Interpretability Visualizations using React☆220Updated last month
- ☆106Updated 5 months ago
- Brain-Inspired Modular Training (BIMT), a method for making neural networks more modular and interpretable.☆163Updated last year
- A domain-specific probabilistic programming language for modeling and inference with language models☆113Updated last year