Alternatives and similar repositories for SAE-Reasoning

Users that are interested in SAE-Reasoning are comparing it to the libraries listed below

• ericwtodd / function_vectors
  Function Vectors in Large Language Models (ICLR 2024)
  ☆190Updated 9 months ago
• OpenMOSS / Language-Model-SAEs
  Performant framework for training, analyzing and visualizing Sparse Autoencoders (SAEs) and their frontier variants.
  ☆175Updated last week
• stanfordnlp / axbench
  Stanford NLP Python library for benchmarking the utility of LLM interpretability methods
  ☆163Updated 7 months ago
• MikaStars39 / FeatureAlignment
  FeatureAlignment = Alignment + Mechanistic Interpretability
  ☆34Updated 10 months ago
• activatedgeek / calibration-tuning
  ☆53Updated 9 months ago
• EleutherAI / delphi
  Delphi was the home of a temple to Phoebus Apollo, which famously had the inscription, 'Know Thyself.' This library lets language models …
  ☆238Updated this week
• ckkissane / crosscoder-model-diff-replication
  Open source replication of Anthropic's Crosscoders for Model Diffing
  ☆63Updated last year
• nrimsky / CAA
  Steering Llama 2 with Contrastive Activation Addition
  ☆207Updated last year
• jacobdunefsky / transcoder_circuits
  ☆195Updated last year
• IBM / activation-steering
  [ICLR 2025] General-purpose activation steering library
  ☆138Updated 4 months ago
• roeehendel / icl_task_vectors
  ☆103Updated 2 years ago
• ajyl / dpo_toxic
  A Mechanistic Understanding of Alignment Algorithms: A Case Study on DPO and Toxicity.
  ☆85Updated 10 months ago
• javiferran / sae_entities
  ☆69Updated 10 months ago
• epfl-dlab / llm-latent-language
  Repo accompanying our paper "Do Llamas Work in English? On the Latent Language of Multilingual Transformers".
  ☆80Updated last year
• ucl-dark / llm_debate
  Code release for "Debating with More Persuasive LLMs Leads to More Truthful Answers"
  ☆124Updated last year
• yuzhaouoe / SAE-based-representation-engineering
  [NAACL'25 Oral] Steering Knowledge Selection Behaviours in LLMs via SAE-Based Representation Engineering
  ☆70Updated 2 weeks ago
• saprmarks / feature-circuits
  ☆205Updated 3 months ago
• balevinstein / Probes
  ☆58Updated 2 years ago
• saprmarks / geometry-of-truth
  ☆99Updated last year
• MingLiiii / Layer_Gradient
  [ACL'25 Oral] What Happened in LLMs Layers when Trained for Fast vs. Slow Thinking: A Gradient Perspective
  ☆75Updated 7 months ago
• UFO-101 / auto-circuit
  A library for efficient patching and automatic circuit discovery.
  ☆86Updated last month
• explanare / ravel
  Evaluate interpretability methods on localizing and disentangling concepts in LLMs.
  ☆57Updated 3 months ago
• dmis-lab / Monet
  [ICLR 2025] Monet: Mixture of Monosemantic Experts for Transformers
  ☆75Updated 7 months ago
• Nix07 / finetuning
  This repository contains the code used for the experiments in the paper "Fine-Tuning Enhances Existing Mechanisms: A Case Study on Entity…
  ☆30Updated 3 months ago
• adamkarvonen / SAEBench
  ☆142Updated last month
• JoshEngels / MultiDimensionalFeatures
  Code for reproducing our paper "Not All Language Model Features Are Linear"
  ☆83Updated last year
• princeton-nlp / Edge-Pruning
  [NeurIPS 2024 Spotlight] Code and data for the paper "Finding Transformer Circuits with Edge Pruning".
  ☆64Updated 5 months ago
• deeplearning-wisc / args
  ☆46Updated last year
• alisawuffles / proxy-tuning
  Code associated with Tuning Language Models by Proxy (Liu et al., 2024)
  ☆127Updated last year
• shuyhere / Awesome-Sparse-Autoencoder
  Collection of Reverse Engineering in Large Model
  ☆36Updated last year