Alternatives and similar repositories for transformer-birth:

Users that are interested in transformer-birth are comparing it to the libraries listed below

• sjelassi / transformers_ssm_copy
  ☆30Updated 11 months ago
• locuslab / edge-of-stability
  ☆63Updated 2 months ago
• gregorbachmann / Next-Token-Failures
  ☆80Updated 11 months ago
• berlino / seq_icl
  ☆51Updated 9 months ago
• shauli-ravfogel / rlace-icml
  ☆35Updated 2 years ago
• princeton-nlp / LM-Kernel-FT
  A Kernel-Based View of Language Model Fine-Tuning https://arxiv.org/abs/2210.05643
  ☆74Updated last year
• Ping-C / optimizer
  This repository includes code to reproduce the tables in "Loss Landscapes are All You Need: Neural Network Generalization Can Be Explaine…
  ☆35Updated last year
• Liuhong99 / implicitbiasmlmcode
  ☆11Updated last year
• sustcsonglin / gated_linear_attention_layer
  ☆33Updated last year
• jmerullo / lm_vector_arithmetic
  ☆31Updated last year
• bergen / EdgeTransformer
  ☆22Updated 3 years ago
• srush / mamba-scans
  Blog post
  ☆16Updated last year
• EleutherAI / w2s
  ☆21Updated 4 months ago
• mansheej / icl-task-diversity
  Code for the paper "Pretraining task diversity and the emergence of non-Bayesian in-context learning for regression"
  ☆20Updated last year
• sustcsonglin / mamba-triton
  ☆47Updated last year
• IdoAmos / not-from-scratch
  ☆28Updated 3 months ago
• r-three / mats
  ☆28Updated 7 months ago
• UFO-101 / auto-circuit
  A library for efficient patching and automatic circuit discovery.
  ☆53Updated this week
• shawntan / stickbreaking-attention
  Stick-breaking attention
  ☆43Updated last month
• HKUNLP / diffusion-vs-ar
  [ICLR 2025] Code for the paper "Beyond Autoregression: Discrete Diffusion for Complex Reasoning and Planning"
  ☆32Updated last week
• shikaiqiu / compute-better-spent
  ☆52Updated 4 months ago
• KihoPark / linear_rep_geometry
  ☆86Updated last week
• MadryLab / DsDm
  ☆46Updated last year
• abhishekpanigrahi1996 / transformer_in_transformer
  ☆44Updated last year
• tml-epfl / sharpness-vs-generalization
  A modern look at the relationship between sharpness and generalization [ICML 2023]
  ☆43Updated last year
• RobertCsordas / ndr
  The official repository for our paper "The Neural Data Router: Adaptive Control Flow in Transformers Improves Systematic Generalization".
  ☆32Updated 3 years ago
• yikangshen / megablocks
  ☆18Updated 8 months ago
• radarFudan / Curse-of-memory
  Curse-of-memory phenomenon of RNNs in sequence modelling
  ☆19Updated this week
• allenbai01 / transformers-as-statisticians
  ☆28Updated last year
• activatedgeek / calibration-tuning
  ☆44Updated 6 months ago