Alternatives and similar repositories for interpretability:

Users that are interested in interpretability are comparing it to the libraries listed below

• mega002 / lm-debugger
  The official code of LM-Debugger, an interactive tool for inspection and intervention in transformer-based language models.
  ☆177Updated 2 years ago
• EleutherAI / knowledge-neurons
  A library for finding knowledge neurons in pretrained transformer models.
  ☆153Updated 2 years ago
• awebson / prompt_semantics
  This repository accompanies our paper “Do Prompt-Based Models Really Understand the Meaning of Their Prompts?”
  ☆85Updated 2 years ago
• neelnanda-io / 1L-Sparse-Autoencoder
  ☆114Updated last year
• nostalgebraist / transformer-utils
  Utilities for the HuggingFace transformers library
  ☆63Updated last year
• TransformerLensOrg / CircuitsVis
  Mechanistic Interpretability Visualizations using React
  ☆219Updated 3 weeks ago
• oxfordinternetinstitute / oxonfair
  Fairness toolkit for pytorch, scikit learn and autogluon
  ☆30Updated last month
• p-lambda / incontext-learning
  Experiments and code to generate the GINC small-scale in-context learning dataset from "An Explanation for In-context Learning as Implici…
  ☆100Updated last year
• mega002 / ff-layers
  The accompanying code for "Transformer Feed-Forward Layers Are Key-Value Memories". Mor Geva, Roei Schuster, Jonathan Berant, and Omer Le…
  ☆89Updated 3 years ago
• evandez / REMEDI
  Inspecting and Editing Knowledge Representations in Language Models
  ☆111Updated last year
• aviclu / ffn-values
  ☆61Updated last year
• guy-dar / embedding-space
  ☆52Updated last year
• davidbau / baukit
  ☆184Updated 10 months ago
• meg-tong / sycophancy-eval
  datasets from the paper "Towards Understanding Sycophancy in Language Models"
  ☆66Updated last year
• moinnadeem / StereoSet
  StereoSet: Measuring stereotypical bias in pretrained language models
  ☆169Updated 2 years ago
• TomFrederik / unseal
  Mechanistic Interpretability for Transformer Models
  ☆49Updated 2 years ago
• adamkarvonen / SAEBench
  ☆41Updated this week
• shauli-ravfogel / nullspace_projection
  ☆87Updated 2 years ago
• ArthurConmy / Automatic-Circuit-Discovery
  ☆201Updated 3 months ago
• explanare / ravel
  Evaluate interpretability methods on localizing and disentangling concepts in LLMs.
  ☆35Updated 3 months ago
• microsoft / biosbias
  Code to reproduce data for Bias in Bios
  ☆43Updated last year
• interpretingdl / eacl2024_transformer_interpretability_tutorial
  Materials for EACL2024 tutorial: Transformer-specific Interpretability
  ☆44Updated 9 months ago
• callummcdougall / sae_vis
  Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).
  ☆176Updated last month
• hendrycks / ethics
  Aligning AI With Shared Human Values (ICLR 2021)
  ☆265Updated last year
• mechanistic-interpretability-grokking / progress-measures-paper
  ☆58Updated 2 years ago
• facebookresearch / ResponsibleNLP
  Repository for research in the field of Responsible NLP at Meta.
  ☆193Updated last month
• evandez / relations
  How do transformer LMs encode relations?
  ☆46Updated 10 months ago
• craffel / llm-seminar
  Seminar on Large Language Models (COMP790-101 at UNC Chapel Hill, Fall 2022)
  ☆309Updated 2 years ago
• UFO-101 / auto-circuit
  A library for efficient patching and automatic circuit discovery.
  ☆46Updated last month
• shauli-ravfogel / rlace-icml
  ☆35Updated 2 years ago