Alternatives and similar repositories for SAE-Reasoning

Users that are interested in SAE-Reasoning are comparing it to the libraries listed below

• ericwtodd / function_vectors
  Function Vectors in Large Language Models (ICLR 2024)
  ☆175Updated 3 months ago
• OpenMOSS / Language-Model-SAEs
  For OpenMOSS Mechanistic Interpretability Team's Sparse Autoencoder (SAE) research.
  ☆141Updated this week
• roeehendel / icl_task_vectors
  ☆96Updated last year
• jacobdunefsky / transcoder_circuits
  ☆154Updated 8 months ago
• epfl-dlab / llm-latent-language
  Repo accompanying our paper "Do Llamas Work in English? On the Latent Language of Multilingual Transformers".
  ☆78Updated last year
• stanfordnlp / axbench
  Stanford NLP Python library for benchmarking the utility of LLM interpretability methods
  ☆112Updated last month
• ajyl / dpo_toxic
  A Mechanistic Understanding of Alignment Algorithms: A Case Study on DPO and Toxicity.
  ☆74Updated 4 months ago
• Nix07 / finetuning
  This repository contains the code used for the experiments in the paper "Fine-Tuning Enhances Existing Mechanisms: A Case Study on Entity…
  ☆27Updated last year
• ckkissane / crosscoder-model-diff-replication
  Open source replication of Anthropic's Crosscoders for Model Diffing
  ☆57Updated 9 months ago
• ucl-dark / llm_debate
  Code release for "Debating with More Persuasive LLMs Leads to More Truthful Answers"
  ☆113Updated last year
• MingLiiii / Layer_Gradient
  [ACL'25 Oral] What Happened in LLMs Layers when Trained for Fast vs. Slow Thinking: A Gradient Perspective
  ☆71Updated last month
• princeton-nlp / Edge-Pruning
  [NeurIPS 2024 Spotlight] Code and data for the paper "Finding Transformer Circuits with Edge Pruning".
  ☆59Updated last week
• dmis-lab / Monet
  [ICLR 2025] Monet: Mixture of Monosemantic Experts for Transformers
  ☆70Updated last month
• UFO-101 / auto-circuit
  A library for efficient patching and automatic circuit discovery.
  ☆73Updated 2 weeks ago
• javiferran / sae_entities
  ☆60Updated 5 months ago
• sail-sg / Attention-Sink
  [ICLR 2025] When Attention Sink Emerges in Language Models: An Empirical View (Spotlight)
  ☆103Updated 3 weeks ago
• EleutherAI / delphi
  Delphi was the home of a temple to Phoebus Apollo, which famously had the inscription, 'Know Thyself.' This library lets language models …
  ☆200Updated this week
• nrimsky / CAA
  Steering Llama 2 with Contrastive Activation Addition
  ☆167Updated last year
• yihedeng9 / rlhf-summary-notes
  A brief and partial summary of RLHF algorithms.
  ☆131Updated 5 months ago
• ahans30 / goldfish-loss
  [NeurIPS 2024] Goldfish Loss: Mitigating Memorization in Generative LLMs
  ☆91Updated 8 months ago
• da03 / Internalize_CoT_Step_by_Step
  ☆187Updated 3 months ago
• facebookresearch / iGSM
  The code for creating the iGSM datasets in papers "Physics of Language Models Part 2.1, Grade-School Math and the Hidden Reasoning Proces…
  ☆61Updated 6 months ago
• saprmarks / geometry-of-truth
  ☆89Updated 11 months ago
• IBM / activation-steering
  [ICLR 2025] General-purpose activation steering library
  ☆87Updated last week
• holarissun / RewardModelingBeyondBradleyTerry
  official implementation of ICLR'2025 paper: Rethinking Bradley-Terry Models in Preference-based Reward Modeling: Foundations, Theory, and…
  ☆66Updated 4 months ago
• bethgelab / sober-reasoning
  A Sober Look at Language Model Reasoning
  ☆81Updated last month
• fc2869 / lo-fit
  LoFiT: Localized Fine-tuning on LLM Representations
  ☆39Updated 6 months ago
• hannamw / EAP-IG
  ☆47Updated last week
• saprmarks / feature-circuits
  ☆183Updated 3 weeks ago
• Dereck0602 / Awesome_Test_Time_LLMs
  ☆117Updated 4 months ago