Alternatives and similar repositories for interpretability:

Users that are interested in interpretability are comparing it to the libraries listed below

• neelnanda-io / 1L-Sparse-Autoencoder
  ☆116Updated last year
• nostalgebraist / transformer-utils
  Utilities for the HuggingFace transformers library
  ☆64Updated 2 years ago
• awebson / prompt_semantics
  This repository accompanies our paper “Do Prompt-Based Models Really Understand the Meaning of Their Prompts?”
  ☆85Updated 2 years ago
• microsoft / biosbias
  Code to reproduce data for Bias in Bios
  ☆43Updated last year
• mega002 / ff-layers
  The accompanying code for "Transformer Feed-Forward Layers Are Key-Value Memories". Mor Geva, Roei Schuster, Jonathan Berant, and Omer Le…
  ☆89Updated 3 years ago
• UFO-101 / auto-circuit
  A library for efficient patching and automatic circuit discovery.
  ☆53Updated 2 months ago
• EleutherAI / knowledge-neurons
  A library for finding knowledge neurons in pretrained transformer models.
  ☆153Updated 3 years ago
• fdalvi / NeuroX
  A Python library that encapsulates various methods for neuron interpretation and analysis in Deep NLP models.
  ☆100Updated last year
• TransformerLensOrg / CircuitsVis
  Mechanistic Interpretability Visualizations using React
  ☆227Updated last month
• mega002 / lm-debugger
  The official code of LM-Debugger, an interactive tool for inspection and intervention in transformer-based language models.
  ☆178Updated 2 years ago
• evandez / REMEDI
  Inspecting and Editing Knowledge Representations in Language Models
  ☆112Updated last year
• oxfordinternetinstitute / oxonfair
  Fairness toolkit for pytorch, scikit learn and autogluon
  ☆31Updated 2 months ago
• interpretingdl / eacl2024_transformer_interpretability_tutorial
  Materials for EACL2024 tutorial: Transformer-specific Interpretability
  ☆44Updated 10 months ago
• KihoPark / LLM_Categorical_Hierarchical_Representations
  ☆81Updated this week
• tongshuangwu / polyjuice
  ☆96Updated 2 years ago
• ArthurConmy / Automatic-Circuit-Discovery
  ☆203Updated 4 months ago
• MadryLab / trak
  A fast, effective data attribution method for neural networks in PyTorch
  ☆192Updated 2 months ago
• EleutherAI / concept-erasure
  Erasing concepts from neural representations with provable guarantees
  ☆222Updated 2 weeks ago
• davidbau / baukit
  ☆189Updated 11 months ago
• timoschick / self-debiasing
  This repository contains the code for "Self-Diagnosis and Self-Debiasing: A Proposal for Reducing Corpus-Based Bias in NLP".
  ☆87Updated 3 years ago
• nrimsky / CAA
  Steering Llama 2 with Contrastive Activation Addition
  ☆122Updated 8 months ago
• callummcdougall / sae_vis
  Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).
  ☆182Updated 2 months ago
• EleutherAI / delphi
  ☆149Updated this week
• TomFrederik / unseal
  Mechanistic Interpretability for Transformer Models
  ☆49Updated 2 years ago
• saprmarks / geometry-of-truth
  ☆76Updated 6 months ago
• guy-dar / embedding-space
  ☆53Updated last year
• shauli-ravfogel / nullspace_projection
  ☆87Updated 2 years ago
• aviclu / ffn-values
  ☆61Updated last year
• redwoodresearch / Easy-Transformer
  ☆109Updated 6 months ago
• steering-vectors / steering-vectors
  Steering vectors for transformer language models in Pytorch / Huggingface
  ☆87Updated 2 months ago