Alternatives and similar repositories for interpretability

Users that are interested in interpretability are comparing it to the libraries listed below

• nostalgebraist / transformer-utils
  Utilities for the HuggingFace transformers library
  ☆72Updated 2 years ago
• ArthurConmy / Automatic-Circuit-Discovery
  ☆242Updated last year
• facebookresearch / ResponsibleNLP
  Repository for research in the field of Responsible NLP at Meta.
  ☆202Updated 4 months ago
• fdalvi / NeuroX
  A Python library that encapsulates various methods for neuron interpretation and analysis in Deep NLP models.
  ☆105Updated 2 years ago
• neelnanda-io / 1L-Sparse-Autoencoder
  ☆127Updated last year
• mega002 / lm-debugger
  The official code of LM-Debugger, an interactive tool for inspection and intervention in transformer-based language models.
  ☆179Updated 3 years ago
• collin-burns / discovering_latent_knowledge
  ☆276Updated last year
• ARBORproject / arborproject.github.io
  ☆81Updated 7 months ago
• inseq-team / inseq
  Interpretability for sequence generation models 🐛 🔍
  ☆438Updated 2 weeks ago
• explanare / ravel
  Evaluate interpretability methods on localizing and disentangling concepts in LLMs.
  ☆54Updated 11 months ago
• hendrycks / ethics
  Aligning AI With Shared Human Values (ICLR 2021)
  ☆299Updated 2 years ago
• AlignmentResearch / tuned-lens
  Tools for understanding how transformer predictions are built layer-by-layer
  ☆530Updated last month
• interpretingdl / eacl2024_transformer_interpretability_tutorial
  Materials for EACL2024 tutorial: Transformer-specific Interpretability
  ☆60Updated last year
• meg-tong / sycophancy-eval
  datasets from the paper "Towards Understanding Sycophancy in Language Models"
  ☆92Updated last year
• mishajw / repeng
  Experiments with representation engineering
  ☆13Updated last year
• evandez / relations
  How do transformer LMs encode relations?
  ☆53Updated last year
• UFO-101 / auto-circuit
  A library for efficient patching and automatic circuit discovery.
  ☆77Updated 2 months ago
• mega002 / ff-layers
  The accompanying code for "Transformer Feed-Forward Layers Are Key-Value Memories". Mor Geva, Roei Schuster, Jonathan Berant, and Omer Le…
  ☆97Updated 4 years ago
• TransformerLensOrg / CircuitsVis
  Mechanistic Interpretability Visualizations using React
  ☆289Updated 9 months ago
• evandez / REMEDI
  Inspecting and Editing Knowledge Representations in Language Models
  ☆116Updated 2 years ago
• redwoodresearch / Easy-Transformer
  ☆123Updated last year
• aryamanarora / causalgym
  CausalGym: Benchmarking causal interpretability methods on linguistic tasks
  ☆47Updated 10 months ago
• steering-vectors / steering-vectors
  Steering vectors for transformer language models in Pytorch / Huggingface
  ☆124Updated 7 months ago
• aviclu / ffn-values
  ☆64Updated 2 years ago
• EleutherAI / delphi
  Delphi was the home of a temple to Phoebus Apollo, which famously had the inscription, 'Know Thyself.' This library lets language models …
  ☆213Updated last week
• mlepori1 / NeuroSurgeon
  NeuroSurgeon is a package that enables researchers to uncover and manipulate subnetworks within models in Huggingface Transformers
  ☆41Updated 7 months ago
• PAIR-code / pretraining-tda
  ☆26Updated 7 months ago
• jacobdunefsky / transcoder_circuits
  ☆173Updated 10 months ago
• EleutherAI / concept-erasure
  Erasing concepts from neural representations with provable guarantees
  ☆237Updated 8 months ago
• KihoPark / LLM_Categorical_Hierarchical_Representations
  ☆109Updated 7 months ago