Alternatives and similar repositories for superposition:

Users that are interested in superposition are comparing it to the libraries listed below

• bilal-chughtai / rep-theory-mech-interp
  ☆26Updated last year
• ethancaballero / broken_neural_scaling_laws
  Code Release for "Broken Neural Scaling Laws" (BNSL) paper
  ☆58Updated last year
• AllanYangZhou / universal_neural_functional
  ☆49Updated last year
• bhoov / energy-transformer-jax
  The Energy Transformer block, in JAX
  ☆56Updated last year
• shikaiqiu / compute-better-spent
  ☆52Updated 5 months ago
• srush / anynp
  Proof-of-concept of global switching between numpy/jax/pytorch in a library.
  ☆18Updated 9 months ago
• KhoomeiK / complexity-scaling
  gzip Predicts Data-dependent Scaling Laws
  ☆34Updated 9 months ago
• callummcdougall / sae_visualizer
  ☆26Updated 11 months ago
• aks2203 / easy-to-hard
  Official repository for the paper "Can You Learn an Algorithm? Generalizing from Easy to Hard Problems with Recurrent Networks"
  ☆60Updated 3 years ago
• Silent-Zebra / twisted-smc-lm
  ☆24Updated 3 weeks ago
• edwardjhu / TP4
  Code accompanying our paper "Feature Learning in Infinite-Width Neural Networks" (https://arxiv.org/abs/2011.14522)
  ☆61Updated 3 years ago
• abhishekpanigrahi1996 / transformer_in_transformer
  ☆44Updated last year
• Sea-Snell / grokking
  unofficial re-implementation of "Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets"
  ☆75Updated 2 years ago
• EleutherAI / features-across-time
  Understanding how features learned by neural networks evolve throughout training
  ☆33Updated 4 months ago
• lee-ny / teaching_arithmetic
  ☆78Updated last year
• young-geng / mintext
  Minimal but scalable implementation of large language models in JAX
  ☆34Updated 4 months ago
• EleutherAI / elk-generalization
  Investigating the generalization behavior of LM probes trained to predict truth labels: (1) from one annotator to another, and (2) from e…
  ☆26Updated 9 months ago
• ejmichaud / grokking-squared
  ☆24Updated 2 years ago
• dylandoblar / noether-networks
  Meta-learning inductive biases in the form of useful conserved quantities.
  ☆37Updated 2 years ago
• jacobdunefsky / transcoder_circuits
  ☆61Updated 4 months ago
• amirzandieh / HyperAttention
  Triton Implementation of HyperAttention Algorithm
  ☆47Updated last year
• berlino / seq_icl
  ☆51Updated 9 months ago
• AsaCooperStickland / situational-awareness-evals
  Measuring the situational awareness of language models
  ☆34Updated last year
• EleutherAI / rnngineering
  Engineering the state of RNN language models (Mamba, RWKV, etc.)
  ☆32Updated 9 months ago
• dvruette / barrel-rec-pytorch
  ☆53Updated last year
• wesg52 / universal-neurons
  Universal Neurons in GPT2 Language Models
  ☆27Updated 9 months ago
• likenneth / q_probe
  Q-Probe: A Lightweight Approach to Reward Maximization for Language Models
  ☆41Updated 9 months ago
• vvvm23 / mamba-jax
  Unofficial but Efficient Implementation of "Mamba: Linear-Time Sequence Modeling with Selective State Spaces" in JAX
  ☆83Updated last year
• apartresearch / interpretability-starter
  🧠 Starter templates for doing interpretability research
  ☆67Updated last year