EleutherAI / sae

Related projects ⓘ

Alternatives and complementary repositories for sae

• jbloomAus / SAELens
  Training Sparse Autoencoders on Language Models
  ☆449Updated this week
• callummcdougall / sae_vis
  Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).
  ☆157Updated last month
• HoagyC / sparse_coding
  Using sparse coding to find distributed representations used by neural networks.
  ☆181Updated 11 months ago
• ai-safety-foundation / sparse_autoencoder
  Sparse Autoencoder for Mechanistic Interpretability
  ☆187Updated 3 months ago
• neelnanda-io / 1L-Sparse-Autoencoder
  ☆108Updated last year
• TransformerLensOrg / CircuitsVis
  Mechanistic Interpretability Visualizations using React
  ☆195Updated 3 months ago
• openai / sparse_autoencoder
  ☆320Updated 3 months ago
• EleutherAI / sae-auto-interp
  ☆99Updated this week
• saprmarks / dictionary_learning
  ☆141Updated 2 weeks ago
• saprmarks / feature-circuits
  ☆102Updated last month
• ndif-team / nnsight
  The nnsight package enables interpreting and manipulating the internals of deep learned models.
  ☆399Updated this week
• ArthurConmy / Automatic-Circuit-Discovery
  ☆186Updated last month
• steering-vectors / steering-vectors
  Steering vectors for transformer language models in Pytorch / Huggingface
  ☆64Updated last month
• ruizheliUOA / Awesome-Interpretability-in-Large-Language-Models
  This repository collects all relevant resources about interpretability in LLMs
  ☆282Updated last week
• andyrdt / refusal_direction
  Code and results accompanying the paper "Refusal in Language Models Is Mediated by a Single Direction".
  ☆117Updated last month
• justinchiu / openlogprobs
  Extract full next-token probabilities via language model APIs
  ☆228Updated 8 months ago
• soniajoseph / ViT-Prisma
  ViT Prisma is a mechanistic interpretability library for Vision Transformers (ViTs).
  ☆173Updated this week
• TransluceAI / observatory
  A toolkit for describing model features and intervening on those features to steer behavior.
  ☆69Updated this week
• jacobdunefsky / transcoder_circuits
  ☆43Updated 4 months ago
• nrimsky / CAA
  Steering Llama 2 with Contrastive Activation Addition
  ☆94Updated 5 months ago
• AlignmentResearch / tuned-lens
  Tools for understanding how transformer predictions are built layer-by-layer
  ☆429Updated 5 months ago
• EleutherAI / concept-erasure
  Erasing concepts from neural representations with provable guarantees
  ☆208Updated 3 weeks ago
• collin-burns / discovering_latent_knowledge
  ☆252Updated 8 months ago
• stanfordnlp / pyvene
  Stanford NLP Python Library for Understanding and Improving PyTorch Models via Interventions
  ☆633Updated this week
• redwoodresearch / Easy-Transformer
  ☆96Updated 3 months ago
• google-deepmind / mishax
  ☆99Updated 3 months ago
• callummcdougall / sae_visualizer
  ☆24Updated 7 months ago
• mcleish7 / arithmetic
  Code to reproduce "Transformers Can Do Arithmetic with the Right Embeddings", McLeish et al (NeurIPS 2024)
  ☆176Updated 5 months ago
• KihoPark / linear_rep_geometry
  ☆75Updated 9 months ago