Alternatives and similar repositories for sparse_autoencoder:

Users that are interested in sparse_autoencoder are comparing it to the libraries listed below

• jbloomAus / SAELens
  Training Sparse Autoencoders on Language Models
  ☆751Updated this week
• EleutherAI / sparsify
  Sparsify transformers with SAEs and transcoders
  ☆524Updated this week
• HoagyC / sparse_coding
  Using sparse coding to find distributed representations used by neural networks.
  ☆240Updated last year
• saprmarks / dictionary_learning
  ☆280Updated 2 months ago
• ai-safety-foundation / sparse_autoencoder
  Sparse Autoencoder for Mechanistic Interpretability
  ☆243Updated 9 months ago
• callummcdougall / sae_vis
  Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).
  ☆199Updated 4 months ago
• AlignmentResearch / tuned-lens
  Tools for understanding how transformer predictions are built layer-by-layer
  ☆490Updated 11 months ago
• TransformerLensOrg / CircuitsVis
  Mechanistic Interpretability Visualizations using React
  ☆242Updated 4 months ago
• ArthurConmy / Automatic-Circuit-Discovery
  ☆223Updated 7 months ago
• jacobdunefsky / transcoder_circuits
  ☆111Updated 5 months ago
• saprmarks / feature-circuits
  ☆164Updated 3 weeks ago
• ndif-team / nnsight
  The nnsight package enables interpreting and manipulating the internals of deep learned models.
  ☆555Updated this week
• allenai / reward-bench
  RewardBench: the first evaluation tool for reward models.
  ☆562Updated this week
• OpenMOSS / Language-Model-SAEs
  For OpenMOSS Mechanistic Interpretability Team's Sparse Autoencoder (SAE) research.
  ☆113Updated this week
• EleutherAI / delphi
  Delphi was the home of a temple to Phoebus Apollo, which famously had the inscription, 'Know Thyself.' This library lets language models …
  ☆170Updated last week
• stanfordnlp / pyvene
  Stanford NLP Python library for understanding and improving PyTorch models via interventions
  ☆739Updated last week
• nrimsky / CAA
  Steering Llama 2 with Contrastive Activation Addition
  ☆147Updated 11 months ago
• ericwtodd / function_vectors
  Function Vectors in Large Language Models (ICLR 2024)
  ☆163Updated 2 weeks ago
• neelnanda-io / 1L-Sparse-Autoencoder
  ☆121Updated last year
• microsoft / rho
  Repo for Rho-1: Token-level Data Selection & Selective Pretraining of LLMs.
  ☆409Updated last year
• cooperleong00 / Awesome-LLM-Interpretability
  A curated list of LLM Interpretability related material - Tutorial, Library, Survey, Paper, Blog, etc..
  ☆233Updated last month
• Dakingrai / awesome-mechanistic-interpretability-lm-papers
  ☆148Updated 5 months ago
• mcleish7 / arithmetic
  Code to reproduce "Transformers Can Do Arithmetic with the Right Embeddings", McLeish et al (NeurIPS 2024)
  ☆189Updated 11 months ago
• redwoodresearch / Easy-Transformer
  ☆114Updated 9 months ago
• davidbau / baukit
  ☆205Updated last year
• likenneth / honest_llama
  Inference-Time Intervention: Eliciting Truthful Answers from a Language Model
  ☆522Updated 3 months ago
• andyzoujm / representation-engineering
  Representation Engineering: A Top-Down Approach to AI Transparency
  ☆827Updated 8 months ago
• andyrdt / refusal_direction
  Code and results accompanying the paper "Refusal in Language Models Is Mediated by a Single Direction".
  ☆213Updated 7 months ago
• ContextualAI / HALOs
  A library with extensible implementations of DPO, KTO, PPO, ORPO, and other human-aware loss functions (HALOs).
  ☆838Updated this week
• voidism / DoLa
  Official implementation for the paper "DoLa: Decoding by Contrasting Layers Improves Factuality in Large Language Models"
  ☆482Updated 3 months ago