Universal Neurons in GPT2 Language Models
☆30May 28, 2024Updated last year
Alternatives and similar repositories for universal-neurons
Users that are interested in universal-neurons are comparing it to the libraries listed below
Sorting:
- Fork of Flame repo for training of some new stuff in development☆19Feb 27, 2026Updated last week
- Code for experiments on transformers using Markovian data.☆22Nov 22, 2024Updated last year
- Sparse probing paper full code.☆67Dec 17, 2023Updated 2 years ago
- ☆140Aug 4, 2024Updated last year
- TransformerLens + HuggingFace☆11Nov 4, 2023Updated 2 years ago
- ☆58Nov 19, 2024Updated last year
- Superposition Yields Robust Neural Scaling☆58Feb 12, 2026Updated 3 weeks ago
- KernelBench v2: Can LLMs Write GPU Kernels? - Benchmark with Torch -> Triton (and more!) problems☆22Jul 4, 2025Updated 8 months ago
- ☆16Oct 20, 2025Updated 4 months ago
- Expanding linear RNN state-transition matrix eigenvalues to include negatives improves state-tracking tasks and language modeling without…☆21Mar 15, 2025Updated 11 months ago
- Official code for the paper "Attention as a Hypernetwork"☆51Feb 24, 2026Updated last week
- ☆19Mar 25, 2025Updated 11 months ago
- ☆16Jul 23, 2024Updated last year
- Transformer related optimization, including BERT, GPT☆14Jun 27, 2023Updated 2 years ago
- ☆23Jan 5, 2025Updated last year
- A library for bridging Python and HTML/Javascript (via Svelte) for creating interactive visualizations☆15Apr 15, 2024Updated last year
- An implementation of the Llama architecture, to instruct and delight☆21May 31, 2025Updated 9 months ago
- Code for reproducing our paper "Not All Language Model Features Are Linear"☆84Nov 27, 2024Updated last year
- Implementation for robust ViT and scaled attention☆21Apr 4, 2025Updated 11 months ago
- ☆23Jun 18, 2024Updated last year
- Mechanistic Interpretability Visualizations using React☆328Dec 18, 2024Updated last year
- ☆102Aug 8, 2024Updated last year
- Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).☆248Feb 27, 2026Updated last week
- Efficient encoder-decoder architecture for small language models (≤1B parameters) with cross-architecture knowledge distillation and visi…☆33Feb 7, 2025Updated last year
- Codebase for Obfuscated Activations Bypass LLM Latent-Space Defenses☆29Feb 11, 2025Updated last year
- Tools for studying developmental interpretability in neural networks.☆127Dec 30, 2025Updated 2 months ago
- ☆28Nov 16, 2025Updated 3 months ago
- Official implementation of "GPT or BERT: why not both?"☆62Jul 28, 2025Updated 7 months ago
- Multi-Layer Sparse Autoencoders (ICLR 2025)☆29Feb 6, 2026Updated last month
- ☆399Aug 21, 2025Updated 6 months ago
- LTG-Bert☆34Jan 8, 2024Updated 2 years ago
- ☆13Oct 5, 2025Updated 5 months ago
- Tools for understanding how transformer predictions are built layer-by-layer☆570Aug 7, 2025Updated 7 months ago
- [ICLR 2025] Monet: Mixture of Monosemantic Experts for Transformers☆75Jun 23, 2025Updated 8 months ago
- Attribution-based Parameter Decomposition☆34Jun 11, 2025Updated 8 months ago
- Delphi was the home of a temple to Phoebus Apollo, which famously had the inscription, 'Know Thyself.' This library lets language models …☆244Mar 2, 2026Updated last week
- Code to break Llama Guard☆32Dec 7, 2023Updated 2 years ago
- Training Sparse Autoencoders on Language Models☆1,233Feb 27, 2026Updated last week
- Landing repository for the paper "Softpick: No Attention Sink, No Massive Activations with Rectified Softmax"☆88Sep 12, 2025Updated 5 months ago