The accompanying code for "Transformer Feed-Forward Layers Are Key-Value Memories". Mor Geva, Roei Schuster, Jonathan Berant, and Omer Levy. EMNLP, 2021.
☆100Sep 5, 2021Updated 4 years ago
Alternatives and similar repositories for ff-layers
Users that are interested in ff-layers are comparing it to the libraries listed below
Sorting:
- ☆68May 18, 2023Updated 2 years ago
- Code for the ACL-2022 paper "Knowledge Neurons in Pretrained Transformers"☆174May 4, 2024Updated last year
- ☆58Jun 15, 2023Updated 2 years ago
- ☆16Jul 10, 2023Updated 2 years ago
- The official code of LM-Debugger, an interactive tool for inspection and intervention in transformer-based language models.☆184May 13, 2022Updated 3 years ago
- Locating and editing factual associations in GPT (NeurIPS 2022)☆736Apr 20, 2024Updated last year
- This repository includes code for the paper "Does Localization Inform Editing? Surprising Differences in Where Knowledge Is Stored vs. Ca…☆61May 9, 2023Updated 2 years ago
- ☆14Apr 27, 2022Updated 3 years ago
- ☆29Apr 30, 2024Updated last year
- ☆16May 14, 2024Updated last year
- Mass-editing thousands of facts into a transformer memory (ICLR 2023)☆544Jan 31, 2024Updated 2 years ago
- Tools for understanding how transformer predictions are built layer-by-layer☆574Aug 7, 2025Updated 7 months ago
- Dataset for Unified Editing, EMNLP 2023. This is a model editing dataset where edits are natural language phrases.☆24Sep 4, 2024Updated last year
- Redwood Research's transformer interpretability tools☆15Apr 15, 2022Updated 3 years ago
- This repository contains the code for "Self-Diagnosis and Self-Debiasing: A Proposal for Reducing Corpus-Based Bias in NLP".☆89Aug 20, 2021Updated 4 years ago
- ☆16Jun 19, 2023Updated 2 years ago
- Mechanistic Interpretability for Transformer Models☆53Jun 1, 2022Updated 3 years ago
- ☆278Oct 1, 2024Updated last year
- MishformerLens intends to be a drop-in replacement for TransformerLens that AST patches HuggingFace Transformers rather than implementing…☆10Oct 7, 2024Updated last year
- ☆48Jan 21, 2024Updated 2 years ago
- ☆44Nov 17, 2024Updated last year
- ☆141Aug 4, 2024Updated last year
- PAIR.withgoogle.com and friend's work on interpretability methods☆224Mar 14, 2026Updated last week
- ☆283Mar 2, 2024Updated 2 years ago
- Sparse probing paper full code.☆67Dec 17, 2023Updated 2 years ago
- Unified access to Large Language Model modules using NNsight☆103Feb 28, 2026Updated 3 weeks ago
- [ICLR 2022] Code for paper "Exploring Extreme Parameter Compression for Pre-trained Language Models"(https://arxiv.org/abs/2205.10036)☆22May 24, 2023Updated 2 years ago
- ☆11Dec 23, 2021Updated 4 years ago
- Codebase the paper "The Remarkable Robustness of LLMs: Stages of Inference?"☆19Jun 11, 2025Updated 9 months ago
- ☆14Feb 24, 2025Updated last year
- Embedding Recycling for Language models☆38Jul 11, 2023Updated 2 years ago
- ☆18Jan 31, 2023Updated 3 years ago
- ☆13Dec 11, 2020Updated 5 years ago
- Data and code for APPDIA: A Discourse-aware Transformer-based Style Transfer Model for Offensive Social Media Conversations (COLING 2022)…☆13Sep 8, 2022Updated 3 years ago
- About The corresponding code from our paper " REFINER: Reasoning Feedback on Intermediate Representations" (EACL 2024). Do not hesitate t…☆74Jan 27, 2026Updated last month
- [ICLR 2025] Monet: Mixture of Monosemantic Experts for Transformers☆76Jun 23, 2025Updated 8 months ago
- This package implements THOR: Transformer with Stochastic Experts.☆64Oct 7, 2021Updated 4 years ago
- Official codebase accompanying our ACL 2022 paper "RELiC: Retrieving Evidence for Literary Claims" (https://relic.cs.umass.edu).☆20May 14, 2022Updated 3 years ago
- IsoBN: Fine-Tuning BERT with Isotropic Batch Normalization☆12Nov 23, 2021Updated 4 years ago