Alternatives and similar repositories for interpretability:

Users that are interested in interpretability are comparing it to the libraries listed below

• neelnanda-io / 1L-Sparse-Autoencoder
  ☆121Updated last year
• ArthurConmy / Automatic-Circuit-Discovery
  ☆213Updated 5 months ago
• UFO-101 / auto-circuit
  A library for efficient patching and automatic circuit discovery.
  ☆59Updated last month
• TomFrederik / unseal
  Mechanistic Interpretability for Transformer Models
  ☆50Updated 2 years ago
• TransformerLensOrg / CircuitsVis
  Mechanistic Interpretability Visualizations using React
  ☆235Updated 3 months ago
• collin-burns / discovering_latent_knowledge
  ☆263Updated last year
• mechanistic-interpretability-grokking / progress-measures-paper
  ☆61Updated 2 years ago
• aviclu / ffn-values
  ☆61Updated last year
• interpretingdl / eacl2024_transformer_interpretability_tutorial
  Materials for EACL2024 tutorial: Transformer-specific Interpretability
  ☆45Updated last year
• mega002 / ff-layers
  The accompanying code for "Transformer Feed-Forward Layers Are Key-Value Memories". Mor Geva, Roei Schuster, Jonathan Berant, and Omer Le…
  ☆90Updated 3 years ago
• anthropics / toy-models-of-superposition
  Notebooks accompanying Anthropic's "Toy Models of Superposition" paper
  ☆117Updated 2 years ago
• EleutherAI / knowledge-neurons
  A library for finding knowledge neurons in pretrained transformer models.
  ☆155Updated 3 years ago
• nostalgebraist / transformer-utils
  Utilities for the HuggingFace transformers library
  ☆66Updated 2 years ago
• EleutherAI / delphi
  Delphi was the home of a temple to Phoebus Apollo, which famously had the inscription, 'Know Thyself.' This library lets language models …
  ☆163Updated this week
• adamkarvonen / SAEBench
  ☆78Updated last week
• wesg52 / sparse-probing-paper
  Sparse probing paper full code.
  ☆55Updated last year
• explanare / ravel
  Evaluate interpretability methods on localizing and disentangling concepts in LLMs.
  ☆42Updated 5 months ago
• steering-vectors / steering-vectors
  Steering vectors for transformer language models in Pytorch / Huggingface
  ☆90Updated last month
• KihoPark / LLM_Categorical_Hierarchical_Representations
  ☆89Updated last month
• saprmarks / geometry-of-truth
  ☆82Updated 7 months ago
• meg-tong / sycophancy-eval
  datasets from the paper "Towards Understanding Sycophancy in Language Models"
  ☆73Updated last year
• jacobdunefsky / transcoder_circuits
  ☆61Updated 4 months ago
• redwoodresearch / Easy-Transformer
  ☆113Updated 7 months ago
• mlepori1 / NeuroSurgeon
  NeuroSurgeon is a package that enables researchers to uncover and manipulate subnetworks within models in Huggingface Transformers
  ☆40Updated last month
• callummcdougall / sae_vis
  Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).
  ☆190Updated 3 months ago
• nrimsky / CAA
  Steering Llama 2 with Contrastive Activation Addition
  ☆131Updated 10 months ago
• HoagyC / sparse_coding
  Using sparse coding to find distributed representations used by neural networks.
  ☆224Updated last year
• guy-dar / embedding-space
  ☆54Updated last year
• davidbau / baukit
  ☆196Updated last year
• evandez / REMEDI
  Inspecting and Editing Knowledge Representations in Language Models
  ☆112Updated last year