Alternatives and similar repositories for SAE-Reasoning

Users that are interested in SAE-Reasoning are comparing it to the libraries listed below

• ericwtodd / function_vectors
  Function Vectors in Large Language Models (ICLR 2024)
  ☆184Updated 7 months ago
• OpenMOSS / Language-Model-SAEs
  Performant framework for training, analyzing and visualizing Sparse Autoencoders (SAEs) and their frontier variants.
  ☆163Updated this week
• stanfordnlp / axbench
  Stanford NLP Python library for benchmarking the utility of LLM interpretability methods
  ☆141Updated 4 months ago
• ckkissane / crosscoder-model-diff-replication
  Open source replication of Anthropic's Crosscoders for Model Diffing
  ☆60Updated last year
• MikaStars39 / FeatureAlignment
  FeatureAlignment = Alignment + Mechanistic Interpretability
  ☆31Updated 8 months ago
• ucl-dark / llm_debate
  Code release for "Debating with More Persuasive LLMs Leads to More Truthful Answers"
  ☆121Updated last year
• activatedgeek / calibration-tuning
  ☆52Updated 7 months ago
• ajyl / dpo_toxic
  A Mechanistic Understanding of Alignment Algorithms: A Case Study on DPO and Toxicity.
  ☆84Updated 8 months ago
• javiferran / sae_entities
  ☆63Updated 8 months ago
• saprmarks / geometry-of-truth
  ☆94Updated last year
• MingLiiii / Layer_Gradient
  [ACL'25 Oral] What Happened in LLMs Layers when Trained for Fast vs. Slow Thinking: A Gradient Perspective
  ☆74Updated 4 months ago
• yuzhaouoe / SAE-based-representation-engineering
  [NAACL'25 Oral] Steering Knowledge Selection Behaviours in LLMs via SAE-Based Representation Engineering
  ☆67Updated 11 months ago
• roeehendel / icl_task_vectors
  ☆101Updated 2 years ago
• ScalerLab / JudgeBench
  ☆103Updated last year
• Nix07 / finetuning
  This repository contains the code used for the experiments in the paper "Fine-Tuning Enhances Existing Mechanisms: A Case Study on Entity…
  ☆28Updated 3 weeks ago
• SynthLabsAI / big-math
  A Large-Scale, High-Quality Math Dataset for Reinforcement Learning in Language Models
  ☆67Updated 8 months ago
• alisawuffles / proxy-tuning
  Code associated with Tuning Language Models by Proxy (Liu et al., 2024)
  ☆121Updated last year
• holarissun / RewardModelingBeyondBradleyTerry
  official implementation of ICLR'2025 paper: Rethinking Bradley-Terry Models in Preference-based Reward Modeling: Foundations, Theory, and…
  ☆69Updated 7 months ago
• socialfoundations / tttlm
  Test-time-training on nearest neighbors for large language models
  ☆47Updated last year
• llm-merging / LLM-Merging
  LLM-Merging: Building LLMs Efficiently through Merging
  ☆205Updated last year
• da03 / Internalize_CoT_Step_by_Step
  ☆198Updated 7 months ago
• clarifying-EM / model-organisms-for-EM
  Code repo for the model organisms and convergent directions of EM papers.
  ☆38Updated 2 months ago
• hbin0701 / Self-Explore
  [𝐄𝐌𝐍𝐋𝐏 𝐅𝐢𝐧𝐝𝐢𝐧𝐠𝐬 𝟐𝟎𝟐𝟒 & 𝐀𝐂𝐋 𝟐𝟎𝟐𝟒 𝐍𝐋𝐑𝐒𝐄 𝐎𝐫𝐚𝐥] 𝘌𝘯𝘩𝘢𝘯𝘤𝘪𝘯𝘨 𝘔𝘢𝘵𝘩𝘦𝘮𝘢𝘵𝘪𝘤𝘢𝘭 𝘙𝘦𝘢𝘴𝘰𝘯𝘪𝘯…
  ☆51Updated last year
• bethgelab / sober-reasoning
  A Sober Look at Language Model Reasoning
  ☆87Updated this week
• jacobdunefsky / transcoder_circuits
  ☆188Updated last year
• epfl-dlab / llm-latent-language
  Repo accompanying our paper "Do Llamas Work in English? On the Latent Language of Multilingual Transformers".
  ☆80Updated last year
• deeplearning-wisc / args
  ☆46Updated last year
• IBM / activation-steering
  [ICLR 2025] General-purpose activation steering library
  ☆119Updated 2 months ago
• nrimsky / CAA
  Steering Llama 2 with Contrastive Activation Addition
  ☆193Updated last year
• yihedeng9 / rlhf-summary-notes
  A brief and partial summary of RLHF algorithms.
  ☆136Updated 8 months ago