Alternatives and similar repositories for interpretability

Users that are interested in interpretability are comparing it to the libraries listed below

• nostalgebraist / transformer-utils
  Utilities for the HuggingFace transformers library
  ☆74Updated 3 years ago
• neelnanda-io / 1L-Sparse-Autoencoder
  ☆132Updated 2 years ago
• TransformerLensOrg / CircuitsVis
  Mechanistic Interpretability Visualizations using React
  ☆318Updated last year
• aaronmueller / MIB
  Landing page for MIB: A Mechanistic Interpretability Benchmark
  ☆24Updated 5 months ago
• KihoPark / LLM_Categorical_Hierarchical_Representations
  ☆112Updated 11 months ago
• ArthurConmy / Automatic-Circuit-Discovery
  ☆267Updated last year
• facebookresearch / ResponsibleNLP
  Repository for research in the field of Responsible NLP at Meta.
  ☆205Updated this week
• meg-tong / sycophancy-eval
  datasets from the paper "Towards Understanding Sycophancy in Language Models"
  ☆102Updated 2 years ago
• redwoodresearch / Easy-Transformer
  ☆137Updated last year
• explanare / ravel
  Evaluate interpretability methods on localizing and disentangling concepts in LLMs.
  ☆57Updated 3 months ago
• EleutherAI / concept-erasure
  Erasing concepts from neural representations with provable guarantees
  ☆243Updated last year
• EleutherAI / delphi
  Delphi was the home of a temple to Phoebus Apollo, which famously had the inscription, 'Know Thyself.' This library lets language models …
  ☆241Updated last week
• steering-vectors / steering-vectors
  Steering vectors for transformer language models in Pytorch / Huggingface
  ☆140Updated 11 months ago
• fdalvi / NeuroX
  A Python library that encapsulates various methods for neuron interpretation and analysis in Deep NLP models.
  ☆106Updated 2 years ago
• ARBORproject / arborproject.github.io
  ☆83Updated 11 months ago
• interpretingdl / eacl2024_transformer_interpretability_tutorial
  Materials for EACL2024 tutorial: Transformer-specific Interpretability
  ☆63Updated last year
• jacobdunefsky / transcoder_circuits
  ☆197Updated last year
• AlignmentResearch / tuned-lens
  Tools for understanding how transformer predictions are built layer-by-layer
  ☆567Updated 5 months ago
• mega002 / lm-debugger
  The official code of LM-Debugger, an interactive tool for inspection and intervention in transformer-based language models.
  ☆182Updated 3 years ago
• adamkarvonen / SAEBench
  ☆143Updated last month
• nrimsky / CAA
  Steering Llama 2 with Contrastive Activation Addition
  ☆207Updated last year
• UFO-101 / auto-circuit
  A library for efficient patching and automatic circuit discovery.
  ☆88Updated last month
• wesg52 / sparse-probing-paper
  Sparse probing paper full code.
  ☆66Updated 2 years ago
• saprmarks / geometry-of-truth
  ☆99Updated last year
• callummcdougall / sae_vis
  Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).
  ☆238Updated last year
• TomFrederik / unseal
  Mechanistic Interpretability for Transformer Models
  ☆53Updated 3 years ago
• davidbau / baukit
  ☆245Updated last year
• guy-dar / embedding-space
  ☆57Updated 2 years ago
• HoagyC / sparse_coding
  Using sparse coding to find distributed representations used by neural networks.
  ☆293Updated 2 years ago
• mishajw / repeng
  Experiments with representation engineering
  ☆13Updated last year