neelnanda-io / GrokkingLinks
A Mechanistic Interpretability Analysis of Grokking
☆22Updated 3 years ago
Alternatives and similar repositories for Grokking
Users that are interested in Grokking are comparing it to the libraries listed below
Sorting:
- Notebooks accompanying Anthropic's "Toy Models of Superposition" paper☆129Updated 3 years ago
- ☆142Updated 2 weeks ago
- 🧠 Starter templates for doing interpretability research☆74Updated 2 years ago
- Investigating the generalization behavior of LM probes trained to predict truth labels: (1) from one annotator to another, and (2) from e…☆28Updated last year
- Code to reproduce "Transformers Can Do Arithmetic with the Right Embeddings", McLeish et al (NeurIPS 2024)☆193Updated last year
- ☆57Updated this week
- we got you bro☆36Updated last year
- ☆127Updated last year
- Accompanying codebase for neuroscope.io, a website for displaying max activating dataset examples for language model neurons☆13Updated 2 years ago
- gzip Predicts Data-dependent Scaling Laws☆34Updated last year
- Sparse Autoencoder Training Library☆54Updated 4 months ago
- Tools for studying developmental interpretability in neural networks.☆103Updated 3 months ago
- Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).☆220Updated 9 months ago
- ☆29Updated last year
- Contains random samples referenced in the paper "Sleeper Agents: Training Robustly Deceptive LLMs that Persist Through Safety Training".☆116Updated last year
- Erasing concepts from neural representations with provable guarantees☆234Updated 8 months ago
- ☆31Updated 6 months ago
- Code associated to papers on superposition (in ML interpretability)☆33Updated 3 years ago
- Omnigrok: Grokking Beyond Algorithmic Data☆62Updated 2 years ago
- Code for reproducing our paper "Not All Language Model Features Are Linear"☆80Updated 10 months ago
- Redwood Research's transformer interpretability tools☆14Updated 3 years ago
- Steering vectors for transformer language models in Pytorch / Huggingface☆124Updated 7 months ago
- Open source interpretability artefacts for R1.☆159Updated 5 months ago
- unofficial re-implementation of "Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets"☆79Updated 3 years ago
- ☆34Updated last year
- Emergent world representations: Exploring a sequence model trained on a synthetic task☆191Updated 2 years ago
- Open source replication of Anthropic's Crosscoders for Model Diffing☆59Updated 11 months ago
- Universal Neurons in GPT2 Language Models☆30Updated last year
- ☆23Updated 7 months ago
- nanoGPT-like codebase for LLM training☆107Updated 4 months ago