Alternatives and similar repositories for switch_sae:

Users that are interested in switch_sae are comparing it to the libraries listed below

• katiekang1998 / reasoning_generalization
  ☆24Updated 3 weeks ago
• yidingjiang / ado
  The repository contains code for Adaptive Data Optimization
  ☆20Updated last month
• EleutherAI / mdl
  Minimum Description Length probing for neural network representations
  ☆18Updated this week
• SamsungSAILMontreal / nino
  Code for "Accelerating Training with Neuron Interaction and Nowcasting Networks"
  ☆17Updated 3 weeks ago
• HazyResearch / aioli
  Aioli: A unified optimization framework for language model data mixing
  ☆19Updated last week
• EleutherAI / features-across-time
  Understanding how features learned by neural networks evolve throughout training
  ☆32Updated 3 months ago
• likenneth / q_probe
  Q-Probe: A Lightweight Approach to Reward Maximization for Language Models
  ☆40Updated 7 months ago
• JoshEngels / SAE-Dark-Matter
  Code for our paper "Decomposing The Dark Matter of Sparse Autoencoders"
  ☆18Updated 3 months ago
• RobertCsordas / moeut
  ☆70Updated 5 months ago
• taufeeque9 / codebook-features
  Sparse and discrete interpretability tool for neural networks
  ☆59Updated 11 months ago
• IBM / ColPret
  Efficient Scaling laws and collaborative pretraining.
  ☆13Updated this week
• KhoomeiK / complexity-scaling
  gzip Predicts Data-dependent Scaling Laws
  ☆33Updated 8 months ago
• microsoft / mechanistic-error-probe
  A mechanistic approach for understanding and detecting factual errors of large language models.
  ☆39Updated 6 months ago
• ahans30 / goldfish-loss
  [NeurIPS 2024] Goldfish Loss: Mitigating Memorization in Generative LLMs
  ☆80Updated 2 months ago
• JoshEngels / MultiDimensionalFeatures
  Code for reproducing our paper "Not All Language Model Features Are Linear"
  ☆66Updated 2 months ago
• kyleliang919 / Online-Subspace-Descent
  This repo is based on https://github.com/jiaweizzhao/GaLore
  ☆23Updated 4 months ago
• sher222 / LeReT
  Learning to Retrieve by Trying - Source code for Grounding by Trying: LLMs with Reinforcement Learning-Enhanced Retrieval
  ☆29Updated 3 months ago
• JacobPfau / fillerTokens
  ☆59Updated 9 months ago
• ethz-spylab / superhuman-ai-consistency
  ☆28Updated last year
• peterljq / Parsimonious-Concept-Engineering
  Implementation of PaCE: Parsimonious Concept Engineering for Large Language Models (NeurIPS 2024)
  ☆31Updated 2 months ago
• kiddyboots216 / lottery-ticket-adaptation
  Lottery Ticket Adaptation
  ☆37Updated 2 months ago
• lucidrains / pause-transformer
  Yet another random morning idea to be quickly tried and architecture shared if it works; to allow the transformer to pause for any amount…
  ☆52Updated last year
• google-deepmind / alta
  ☆21Updated 3 months ago
• shreyansh26 / Attention-Mask-Patterns
  Using FlexAttention to compute attention with different masking patterns
  ☆40Updated 4 months ago
• dangxingyu / rnn-icrag
  Official repository of paper "RNNs Are Not Transformers (Yet): The Key Bottleneck on In-context Retrieval"
  ☆25Updated 9 months ago
• ml-jku / EVA
  One Initialization to Rule them All: Fine-tuning via Explained Variance Adaptation
  ☆36Updated 3 months ago
• r-three / phatgoose
  Code for PHATGOOSE introduced in "Learning to Route Among Specialized Experts for Zero-Shot Generalization"
  ☆80Updated 11 months ago
• aszala / EnvGen
  Official Code Repository for EnvGen: Generating and Adapting Environments via LLMs for Training Embodied Agents (COLM 2024)
  ☆27Updated 6 months ago
• RobertCsordas / moe
  Official repository for the paper "Approximating Two-Layer Feedforward Networks for Efficient Transformers"
  ☆36Updated last year