Alternatives and similar repositories for SAE-Reasoning

Users that are interested in SAE-Reasoning are comparing it to the libraries listed below

• ericwtodd / function_vectors
  Function Vectors in Large Language Models (ICLR 2024)
  ☆189Updated 8 months ago
• MikaStars39 / FeatureAlignment
  FeatureAlignment = Alignment + Mechanistic Interpretability
  ☆34Updated 10 months ago
• OpenMOSS / Language-Model-SAEs
  Performant framework for training, analyzing and visualizing Sparse Autoencoders (SAEs) and their frontier variants.
  ☆168Updated this week
• stanfordnlp / axbench
  Stanford NLP Python library for benchmarking the utility of LLM interpretability methods
  ☆161Updated 6 months ago
• ucl-dark / llm_debate
  Code release for "Debating with More Persuasive LLMs Leads to More Truthful Answers"
  ☆124Updated last year
• nrimsky / CAA
  Steering Llama 2 with Contrastive Activation Addition
  ☆204Updated last year
• roeehendel / icl_task_vectors
  ☆103Updated 2 years ago
• epfl-dlab / llm-latent-language
  Repo accompanying our paper "Do Llamas Work in English? On the Latent Language of Multilingual Transformers".
  ☆80Updated last year
• javiferran / sae_entities
  ☆68Updated 10 months ago
• ajyl / dpo_toxic
  A Mechanistic Understanding of Alignment Algorithms: A Case Study on DPO and Toxicity.
  ☆85Updated 10 months ago
• activatedgeek / calibration-tuning
  ☆52Updated 9 months ago
• Nix07 / finetuning
  This repository contains the code used for the experiments in the paper "Fine-Tuning Enhances Existing Mechanisms: A Case Study on Entity…
  ☆29Updated 2 months ago
• jacobdunefsky / transcoder_circuits
  ☆193Updated last year
• saprmarks / geometry-of-truth
  ☆98Updated last year
• ckkissane / crosscoder-model-diff-replication
  Open source replication of Anthropic's Crosscoders for Model Diffing
  ☆63Updated last year
• EleutherAI / delphi
  Delphi was the home of a temple to Phoebus Apollo, which famously had the inscription, 'Know Thyself.' This library lets language models …
  ☆235Updated 2 weeks ago
• IBM / activation-steering
  [ICLR 2025] General-purpose activation steering library
  ☆133Updated 3 months ago
• saprmarks / feature-circuits
  ☆202Updated 2 months ago
• facebookresearch / iGSM
  The code for creating the iGSM datasets in papers "Physics of Language Models Part 2.1, Grade-School Math and the Hidden Reasoning Proces…
  ☆81Updated 11 months ago
• alisawuffles / proxy-tuning
  Code associated with Tuning Language Models by Proxy (Liu et al., 2024)
  ☆127Updated last year
• shuyhere / Awesome-Sparse-Autoencoder
  Collection of Reverse Engineering in Large Model
  ☆36Updated last year
• UFO-101 / auto-circuit
  A library for efficient patching and automatic circuit discovery.
  ☆84Updated last week
• holarissun / RewardModelingBeyondBradleyTerry
  official implementation of ICLR'2025 paper: Rethinking Bradley-Terry Models in Preference-based Reward Modeling: Foundations, Theory, and…
  ☆70Updated 9 months ago
• joeljang / RLPHF
  Personalized Soups: Personalized Large Language Model Alignment via Post-hoc Parameter Merging
  ☆116Updated 2 years ago
• zankner / CLoud
  Critique-out-Loud Reward Models
  ☆70Updated last year
• JoshEngels / MultiDimensionalFeatures
  Code for reproducing our paper "Not All Language Model Features Are Linear"
  ☆83Updated last year
• TIGER-AI-Lab / CritiqueFineTuning
  Code for "Critique Fine-Tuning: Learning to Critique is More Effective than Learning to Imitate" [COLM 2025]
  ☆180Updated 6 months ago
• dmis-lab / Monet
  [ICLR 2025] Monet: Mixture of Monosemantic Experts for Transformers
  ☆74Updated 6 months ago
• yuzhaouoe / SAE-based-representation-engineering
  [NAACL'25 Oral] Steering Knowledge Selection Behaviours in LLMs via SAE-Based Representation Engineering
  ☆68Updated last year
• deeplearning-wisc / args
  ☆46Updated last year