Alternatives and similar repositories for SuperpositionScaling

Users that are interested in SuperpositionScaling are comparing it to the libraries listed below

• taufeeque9 / codebook-features
  Sparse and discrete interpretability tool for neural networks
  ☆65Updated last year
• HKUNLP / DiffuSearch
  [ICLR 2025] Code for the paper "Implicit Search via Discrete Diffusion: A Study on Chess"
  ☆36Updated 10 months ago
• gregorbachmann / Next-Token-Failures
  ☆107Updated last year
• epfml / schedules-and-scaling
  Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"
  ☆87Updated last year
• wesg52 / universal-neurons
  Universal Neurons in GPT2 Language Models
  ☆31Updated last year
• adamkarvonen / SAE_BoardGameEval
  ☆23Updated 11 months ago
• shreyansh26 / Attention-Mask-Patterns
  Using FlexAttention to compute attention with different masking patterns
  ☆47Updated last year
• matchten / LoRA-Models-for-SAEs
  Code for reproducing our paper "Low Rank Adapting Models for Sparse Autoencoder Features"
  ☆17Updated 9 months ago
• apple / ml-reversal-blessing
  ☆18Updated 5 months ago
• katiekang1998 / reasoning_generalization
  ☆33Updated last year
• hamishivi / EasyLM
  Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…
  ☆78Updated last year
• IdoAmos / not-from-scratch
  ☆33Updated last year
• sail-sg / VeriFree
  Reinforcing General Reasoning without Verifiers
  ☆93Updated 6 months ago
• mlfoundations / scaling
  Language models scale reliably with over-training and on downstream tasks
  ☆100Updated last year
• ethancaballero / broken_neural_scaling_laws
  Code Release for "Broken Neural Scaling Laws" (BNSL) paper
  ☆59Updated 2 years ago
• Asap7772 / understanding-rlhf
  Learning from preferences is a common paradigm for fine-tuning language models. Yet, many algorithmic design decisions come into play. Ou…
  ☆32Updated last year
• HKUNLP / diffusion-vs-ar
  [ICLR 2025] Code for the paper "Beyond Autoregression: Discrete Diffusion for Complex Reasoning and Planning"
  ☆87Updated 10 months ago
• cmu-l3 / neurips2024-inference-tutorial-code
  NeurIPS 2024 tutorial on LLM Inference
  ☆47Updated last year
• probabilistic-inference-scaling / probabilistic-inference-scaling
  ☆52Updated 9 months ago
• clarifying-EM / model-organisms-for-EM
  Code repo for the model organisms and convergent directions of EM papers.
  ☆41Updated 3 months ago
• RobertCsordas / moeut
  ☆91Updated last year
• hamishivi / automated-instruction-selection
  Exploration of automated dataset selection approaches at large scales.
  ☆53Updated 10 months ago
• srush / mamba-primer
  ☆38Updated last year
• lili-chen / self-questioning-lm
  Self-Questioning Language Models
  ☆56Updated last week
• saprmarks / geometry-of-truth
  ☆98Updated last year
• hughbzhang / o1_inference_scaling_laws
  Replicating O1 inference-time scaling laws
  ☆91Updated last year
• ChenWu98 / algorithmic-creativity
  [ICML 2025] Roll the dice & look before you leap: Going beyond the creative limits of next-token prediction
  ☆82Updated 7 months ago
• justinlovelace / Diffusion-Guided-LM
  ☆29Updated 2 months ago
• p-lambda / incontext-learning
  Experiments and code to generate the GINC small-scale in-context learning dataset from "An Explanation for In-context Learning as Implici…
  ☆106Updated 2 years ago
• janphilippfranken / sami
  Self-Supervised Alignment with Mutual Information
  ☆20Updated last year