Alternatives and similar repositories for SAE-Reasoning

Users that are interested in SAE-Reasoning are comparing it to the libraries listed below

• ericwtodd / function_vectors
  Function Vectors in Large Language Models (ICLR 2024)
  ☆187Updated 7 months ago
• OpenMOSS / Language-Model-SAEs
  Performant framework for training, analyzing and visualizing Sparse Autoencoders (SAEs) and their frontier variants.
  ☆168Updated this week
• stanfordnlp / axbench
  Stanford NLP Python library for benchmarking the utility of LLM interpretability methods
  ☆151Updated 5 months ago
• javiferran / sae_entities
  ☆66Updated 9 months ago
• roeehendel / icl_task_vectors
  ☆103Updated 2 years ago
• jacobdunefsky / transcoder_circuits
  ☆191Updated last year
• MikaStars39 / FeatureAlignment
  FeatureAlignment = Alignment + Mechanistic Interpretability
  ☆33Updated 9 months ago
• EleutherAI / delphi
  Delphi was the home of a temple to Phoebus Apollo, which famously had the inscription, 'Know Thyself.' This library lets language models …
  ☆231Updated last week
• ckkissane / crosscoder-model-diff-replication
  Open source replication of Anthropic's Crosscoders for Model Diffing
  ☆63Updated last year
• Nix07 / finetuning
  This repository contains the code used for the experiments in the paper "Fine-Tuning Enhances Existing Mechanisms: A Case Study on Entity…
  ☆28Updated last month
• activatedgeek / calibration-tuning
  ☆52Updated 8 months ago
• nrimsky / CAA
  Steering Llama 2 with Contrastive Activation Addition
  ☆198Updated last year
• da03 / Internalize_CoT_Step_by_Step
  ☆200Updated 7 months ago
• ucl-dark / llm_debate
  Code release for "Debating with More Persuasive LLMs Leads to More Truthful Answers"
  ☆122Updated last year
• saprmarks / feature-circuits
  ☆195Updated 2 months ago
• yuzhaouoe / SAE-based-representation-engineering
  [NAACL'25 Oral] Steering Knowledge Selection Behaviours in LLMs via SAE-Based Representation Engineering
  ☆67Updated last year
• dmis-lab / Monet
  [ICLR 2025] Monet: Mixture of Monosemantic Experts for Transformers
  ☆74Updated 5 months ago
• epfl-dlab / llm-latent-language
  Repo accompanying our paper "Do Llamas Work in English? On the Latent Language of Multilingual Transformers".
  ☆80Updated last year
• ajyl / dpo_toxic
  A Mechanistic Understanding of Alignment Algorithms: A Case Study on DPO and Toxicity.
  ☆84Updated 9 months ago
• shuyhere / Awesome-Sparse-Autoencoder
  Collection of Reverse Engineering in Large Model
  ☆36Updated 11 months ago
• MingLiiii / Layer_Gradient
  [ACL'25 Oral] What Happened in LLMs Layers when Trained for Fast vs. Slow Thinking: A Gradient Perspective
  ☆74Updated 5 months ago
• zjunlp / KnowledgeCircuits
  [NeurIPS 2024] Knowledge Circuits in Pretrained Transformers
  ☆159Updated last month
• tim-lawson / mlsae
  Multi-Layer Sparse Autoencoders (ICLR 2025)
  ☆27Updated 10 months ago
• TIGER-AI-Lab / CritiqueFineTuning
  Code for "Critique Fine-Tuning: Learning to Critique is More Effective than Learning to Imitate" [COLM 2025]
  ☆179Updated 5 months ago
• alisawuffles / proxy-tuning
  Code associated with Tuning Language Models by Proxy (Liu et al., 2024)
  ☆125Updated last year
• deeplearning-wisc / args
  ☆46Updated last year
• joeljang / RLPHF
  Personalized Soups: Personalized Large Language Model Alignment via Post-hoc Parameter Merging
  ☆113Updated 2 years ago
• socialfoundations / tttlm
  Test-time-training on nearest neighbors for large language models
  ☆48Updated last year
• Dakingrai / awesome-mechanistic-interpretability-lm-papers
  ☆223Updated last year
• WindyLee0822 / Process_Q_Model
  official implementation of paper "Process Reward Model with Q-value Rankings"
  ☆65Updated 10 months ago