Interpretability for sequence generation models 🐛 🔍
☆460Feb 2, 2026Updated last month
Alternatives and similar repositories for inseq
Users that are interested in inseq are comparing it to the libraries listed below
Sorting:
- Materials for "Quantifying the Plausibility of Context Reliance in Neural Machine Translation" at ICLR'24 🐑 🐑☆15Apr 18, 2024Updated last year
- A python package for benchmarking interpretability techniques on Transformers.☆215Sep 29, 2024Updated last year
- Explain, analyze, and visualize NLP language models. Ecco creates interactive visualizations directly in Jupyter notebooks explaining the…☆2,085Aug 15, 2024Updated last year
- Interpreting Language Models with Contrastive Explanations (EMNLP 2022 Best Paper Honorable Mention)☆62May 12, 2022Updated 3 years ago
- Delphi was the home of a temple to Phoebus Apollo, which famously had the inscription, 'Know Thyself.' This library lets language models …☆244Mar 2, 2026Updated last week
- A python package to run inference with HuggingFace language and vision-language checkpoints wrapping many convenient features.☆28Sep 14, 2024Updated last year
- Easy-to-use MIRAGE code for faithful answer attribution in RAG applications. Paper: https://aclanthology.org/2024.emnlp-main.347/☆26Mar 10, 2025Updated 11 months ago
- Layer-wise Relevance Propagation for Large Language Models and Vision Transformers [ICML 2024]☆222Jul 11, 2025Updated 7 months ago
- Model explainability that works seamlessly with 🤗 transformers. Explain your transformers model in just 2 lines of code.☆1,413Aug 30, 2023Updated 2 years ago
- Landing page for MIB: A Mechanistic Interpretability Benchmark☆24Aug 15, 2025Updated 6 months ago
- A library for mechanistic interpretability of GPT-style language models☆3,154Updated this week
- ☆275Oct 1, 2024Updated last year
- Codes for "Benchmarking the Generation of Fact Checking Explanations"☆10Aug 16, 2024Updated last year
- Code and models for the COLING2020 paper "Bridging the Gap in Multilingual Semantic Role Labeling: a Language-Agnostic Approach".☆12Dec 2, 2022Updated 3 years ago
- HyPe: Better Pre-trained Language Model Fine-tuning with Hidden Representation Perturbation [ACL 2023]☆14Jul 11, 2023Updated 2 years ago
- Code for the NAACL 2024 HCI+NLP Workshop paper "LLMCheckup: Conversational Examination of Large Language Models via Interpretability Tool…☆13Mar 24, 2024Updated last year
- This repository collects all relevant resources about interpretability in LLMs☆390Nov 1, 2024Updated last year
- Tools for understanding how transformer predictions are built layer-by-layer☆570Aug 7, 2025Updated 7 months ago
- PyTorch and NNsight implementation of AtP* (Kramar et al 2024, DeepMind)☆20Jan 19, 2025Updated last year
- 👩💻 Code for the ACL paper "Detecting Edit Failures in LLMs: An Improved Specificity Benchmark"☆20Jan 19, 2024Updated 2 years ago
- Facebook AI Research Sequence-to-Sequence Toolkit written in Python.☆12Oct 10, 2020Updated 5 years ago
- The nnsight package enables interpreting and manipulating the internals of deep learned models.☆836Updated this week
- ☆65Aug 7, 2023Updated 2 years ago
- A Unified Library for Parameter-Efficient and Modular Transfer Learning☆2,801Mar 1, 2026Updated last week
- ☆13Jun 4, 2024Updated last year
- ☆13Feb 7, 2023Updated 3 years ago
- Model interpretability and understanding for PyTorch☆5,564Feb 26, 2026Updated last week
- LLM experiments done during SERI MATS - focusing on activation steering / interpreting activation spaces☆102Sep 21, 2023Updated 2 years ago
- ☆399Aug 21, 2025Updated 6 months ago
- Efficient few-shot learning with Sentence Transformers☆2,690Dec 11, 2025Updated 2 months ago
- Training Sparse Autoencoders on Language Models☆1,245Feb 27, 2026Updated last week
- ☆19Sep 16, 2025Updated 5 months ago
- ☆14Jan 10, 2024Updated 2 years ago
- ☆20Jan 16, 2024Updated 2 years ago
- ☆552Feb 5, 2024Updated 2 years ago
- PyTorch + HuggingFace code for RetoMaton: "Neuro-Symbolic Language Modeling with Automaton-augmented Retrieval" (ICML 2022), including an…☆286Oct 20, 2022Updated 3 years ago
- Sparsify transformers with SAEs and transcoders☆699Mar 2, 2026Updated last week
- The official code of LM-Debugger, an interactive tool for inspection and intervention in transformer-based language models.☆184May 13, 2022Updated 3 years ago
- Erasing concepts from neural representations with provable guarantees☆243Jan 27, 2025Updated last year