Alternatives and similar repositories for switch_sae:

Users that are interested in switch_sae are comparing it to the libraries listed below

• JoshEngels / SAE-Dark-Matter
  Code for our paper "Decomposing The Dark Matter of Sparse Autoencoders"
  ☆21Updated last month
• IBM / ColPret
  Efficient Scaling laws and collaborative pretraining.
  ☆15Updated last month
• likenneth / q_probe
  Q-Probe: A Lightweight Approach to Reward Maximization for Language Models
  ☆41Updated 9 months ago
• katiekang1998 / reasoning_generalization
  ☆30Updated 2 months ago
• samuelarnesen / nyu-debate-modeling
  ☆20Updated 5 months ago
• yidingjiang / ado
  The repository contains code for Adaptive Data Optimization
  ☆20Updated 3 months ago
• cmu-l3 / neurips2024-inference-tutorial-code
  NeurIPS 2024 tutorial on LLM Inference
  ☆39Updated 3 months ago
• Asap7772 / understanding-rlhf
  ☆25Updated 10 months ago
• EleutherAI / elk-generalization
  Investigating the generalization behavior of LM probes trained to predict truth labels: (1) from one annotator to another, and (2) from e…
  ☆26Updated 9 months ago
• SamsungSAILMontreal / nino
  Code for "Accelerating Training with Neuron Interaction and Nowcasting Networks" [to appear at ICLR 2025]
  ☆18Updated last week
• kiddyboots216 / lottery-ticket-adaptation
  Lottery Ticket Adaptation
  ☆38Updated 3 months ago
• XiangLi1999 / AutoBencher
  ☆26Updated 8 months ago
• KhoomeiK / complexity-scaling
  gzip Predicts Data-dependent Scaling Laws
  ☆34Updated 9 months ago
• peterljq / Parsimonious-Concept-Engineering
  Implementation of PaCE: Parsimonious Concept Engineering for Large Language Models (NeurIPS 2024)
  ☆33Updated 4 months ago
• microsoft / mechanistic-error-probe
  A mechanistic approach for understanding and detecting factual errors of large language models.
  ☆41Updated 8 months ago
• ethz-spylab / superhuman-ai-consistency
  ☆28Updated last year
• JoshEngels / MultiDimensionalFeatures
  Code for reproducing our paper "Not All Language Model Features Are Linear"
  ☆70Updated 3 months ago
• sher222 / LeReT
  Learning to Retrieve by Trying - Source code for Grounding by Trying: LLMs with Reinforcement Learning-Enhanced Retrieval
  ☆32Updated 4 months ago
• kyleliang919 / Online-Subspace-Descent
  This repo is based on https://github.com/jiaweizzhao/GaLore
  ☆26Updated 6 months ago
• shawntan / stickbreaking-attention
  Stick-breaking attention
  ☆48Updated this week
• EleutherAI / delphi
  Delphi was the home of a temple to Phoebus Apollo, which famously had the inscription, 'Know Thyself.' This library lets language models …
  ☆161Updated this week
• ml-jku / EVA
  One Initialization to Rule them All: Fine-tuning via Explained Variance Adaptation
  ☆38Updated 5 months ago
• r-three / phatgoose
  Code for PHATGOOSE introduced in "Learning to Route Among Specialized Experts for Zero-Shot Generalization"
  ☆81Updated last year
• jiahai-feng / binding-iclr
  ☆12Updated last year
• hamishivi / EasyLM
  Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…
  ☆66Updated 7 months ago
• hughbzhang / o1_inference_scaling_laws
  Replicating O1 inference-time scaling laws
  ☆83Updated 3 months ago
• codezakh / DataEnvGym
  A testbed for agents and environments that can automatically improve models through data generation.
  ☆21Updated 2 weeks ago