PAIR-code / interpretabilityLinks
PAIR.withgoogle.com and friend's work on interpretability methods
☆207Updated last month
Alternatives and similar repositories for interpretability
Users that are interested in interpretability are comparing it to the libraries listed below
Sorting:
- Utilities for the HuggingFace transformers library☆72Updated 2 years ago
- Evaluate interpretability methods on localizing and disentangling concepts in LLMs.☆56Updated last year
- ☆128Updated last year
- Inspecting and Editing Knowledge Representations in Language Models☆117Updated 2 years ago
- ☆81Updated 8 months ago
- A Python library that encapsulates various methods for neuron interpretation and analysis in Deep NLP models.☆106Updated 2 years ago
- Landing page for MIB: A Mechanistic Interpretability Benchmark☆20Updated 2 months ago
- The Prism Alignment Project☆82Updated last year
- ☆126Updated last year
- The official code of LM-Debugger, an interactive tool for inspection and intervention in transformer-based language models.☆179Updated 3 years ago
- ☆247Updated last year
- datasets from the paper "Towards Understanding Sycophancy in Language Models"☆94Updated 2 years ago
- LLM experiments done during SERI MATS - focusing on activation steering / interpreting activation spaces☆98Updated 2 years ago
- Aligning AI With Shared Human Values (ICLR 2021)☆303Updated 2 years ago
- A library for efficient patching and automatic circuit discovery.☆78Updated 3 months ago
- Materials for EACL2024 tutorial: Transformer-specific Interpretability☆60Updated last year
- ☆279Updated last year
- Repository for research in the field of Responsible NLP at Meta.☆202Updated 5 months ago
- Sparse probing paper full code.☆62Updated last year
- Mechanistic Interpretability Visualizations using React☆293Updated 10 months ago
- Steering vectors for transformer language models in Pytorch / Huggingface☆126Updated 8 months ago
- The accompanying code for "Transformer Feed-Forward Layers Are Key-Value Memories". Mor Geva, Roei Schuster, Jonathan Berant, and Omer Le…☆97Updated 4 years ago
- ☆92Updated last year
- Tools for understanding how transformer predictions are built layer-by-layer☆535Updated 2 months ago
- Delphi was the home of a temple to Phoebus Apollo, which famously had the inscription, 'Know Thyself.' This library lets language models …☆219Updated last week
- ☆181Updated 11 months ago
- Experiments with representation engineering☆13Updated last year
- ☆256Updated 7 months ago
- Erasing concepts from neural representations with provable guarantees☆238Updated 9 months ago
- CausalGym: Benchmarking causal interpretability methods on linguistic tasks☆48Updated 10 months ago