Alternatives and similar repositories for Sparse-Autoencoder

Users that are interested in Sparse-Autoencoder are comparing it to the libraries listed below

• ai-safety-foundation / sparse_autoencoder
  Sparse Autoencoder for Mechanistic Interpretability
  ☆290Updated last year
• jacobmarks / awesome-neurips-2023
  Conference schedule, top papers, and analysis of the data for NeurIPS 2023!
  ☆120Updated 2 years ago
• jonhue / activeft
  PyTorch library for Active Fine-Tuning
  ☆96Updated 4 months ago
• multimodal-interpretability / maia
  Official implementation of MAIA, A Multimodal Automated Interpretability Agent
  ☆102Updated 3 months ago
• huggingface / ai-deadlines
  ⏰ AI conference deadline countdowns
  ☆320Updated last week
• FarnoushRJ / MambaLRP
  [NeurIPS 2024] Official implementation of the paper "MambaLRP: Explaining Selective State Space Sequence Models" 🐍
  ☆45Updated last year
• FOR-sight-ai / interpreto
  🪄 Interpreto is an interpretability toolbox for LLMs
  ☆139Updated last week
• Jaykef / ai-algorithms
  First-principle implementations of groundbreaking AI algorithms using a wide range of deep learning frameworks, accompanied by supporting…
  ☆181Updated 6 months ago
• uclaml / MoE
  Towards Understanding the Mixture-of-Experts Layer in Deep Learning
  ☆34Updated 2 years ago
• Prisma-Multimodal / ViT-Prisma
  ViT Prisma is a mechanistic interpretability library for Vision and Video Transformers (ViTs).
  ☆337Updated 6 months ago
• kyegomez / SimpleMamba
  Implementation of a modular, high-performance, and simplistic mamba for high-speed applications
  ☆40Updated last year
• callummcdougall / sae_vis
  Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).
  ☆238Updated last year
• saprmarks / dictionary_learning
  ☆388Updated 5 months ago
• ApolloResearch / e2e_sae
  Sparse Autoencoder Training Library
  ☆56Updated 9 months ago
• Zyphra / BlackMamba
  Code repository for Black Mamba
  ☆261Updated last year
• CG80499 / KAN-GPT-2
  Training small GPT-2 style models using Kolmogorov-Arnold networks.
  ☆121Updated last year
• BorealisAI / flora-opt
  This is the official repository for the paper "Flora: Low-Rank Adapters Are Secretly Gradient Compressors" in ICML 2024.
  ☆106Updated last year
• steering-vectors / steering-vectors
  Steering vectors for transformer language models in Pytorch / Huggingface
  ☆140Updated 11 months ago
• dilyabareeva / quanda
  A toolkit for quantitative evaluation of data attribution methods.
  ☆55Updated 6 months ago
• rachtibat / LRP-eXplains-Transformers
  Layer-wise Relevance Propagation for Large Language Models and Vision Transformers [ICML 2024]
  ☆219Updated 6 months ago
• bartbussmann / matryoshka_sae
  ☆58Updated last year
• apple / ml-act
  ☆58Updated last year
• dmis-lab / Monet
  [ICLR 2025] Monet: Mixture of Monosemantic Experts for Transformers
  ☆75Updated 7 months ago
• kyegomez / Jamba
  PyTorch Implementation of Jamba: "Jamba: A Hybrid Transformer-Mamba Language Model"
  ☆205Updated 3 weeks ago
• bartbussmann / BatchTopK
  Implementation of the BatchTopK activation function for training sparse autoencoders (SAEs)
  ☆60Updated 6 months ago
• kyegomez / MambaTransformer
  Integrating Mamba/SSMs with Transformer for Enhanced Long Context and High-Quality Sequence Modeling
  ☆213Updated last week
• MadryLab / modelcomponents
  Decomposing and Editing Predictions by Modeling Model Computation
  ☆139Updated last year
• adamkarvonen / SAEBench
  ☆143Updated last month
• ApolloResearch / apd
  Attribution-based Parameter Decomposition
  ☆33Updated 7 months ago
• EleutherAI / sparsify
  Sparsify transformers with SAEs and transcoders
  ☆688Updated last week