Alternatives and similar repositories for llama-titans

Users that are interested in llama-titans are comparing it to the libraries listed below

• Cranial-XIX / longhorn
  Official PyTorch Implementation of the Longhorn Deep State Space Model
  ☆54Updated 8 months ago
• IdoAmos / not-from-scratch
  ☆33Updated 10 months ago
• machine-discovery / deer
  Parallelizing non-linear sequential models over the sequence length
  ☆54Updated 2 months ago
• goombalab / phi-mamba
  Official implementation of Phi-Mamba. A MOHAWK-distilled model (Transformers to SSMs: Distilling Quadratic Knowledge to Subquadratic Mode…
  ☆114Updated 11 months ago
• huyphan168 / PEER
  Mixture of A Million Experts
  ☆46Updated last year
• Blackzxy / LoGAH
  ☆22Updated 11 months ago
• alxndrTL / othello_mamba
  Evaluating the Mamba architecture on the Othello game
  ☆48Updated last year
• kazuki-irie / kv-memory-brain
  Official Code Repository for the paper "Key-value memory in the brain"
  ☆28Updated 6 months ago
• zqOuO / GWT
  ☆13Updated 7 months ago
• convergence-ai / lm2
  Official repo of paper LM2
  ☆41Updated 6 months ago
• google-deepmind / spectral_ssm
  ☆34Updated last year
• OpenNLPLab / HGRN2
  HGRN2: Gated Linear RNNs with State Expansion
  ☆54Updated last year
• RobertCsordas / moeut
  ☆85Updated last year
• alvin-zyl / CoLA
  Implementation of CoLA: Compute-Efficient Pre-Training of LLMs via Low-Rank Activation
  ☆23Updated 6 months ago
• radarFudan / mamba-minimal-jax
  ☆31Updated 9 months ago
• Leiay / looped_transformer
  ☆33Updated last year
• shawntan / stickbreaking-attention
  Stick-breaking attention
  ☆59Updated 2 months ago
• berlino / seq_icl
  ☆53Updated last year
• shikaiqiu / compute-better-spent
  ☆56Updated 10 months ago
• proger / hippogriff
  Griffin MQA + Hawk Linear RNN Hybrid
  ☆88Updated last year
• Benjamin-Walker / selective-ssms-and-linear-cdes
  Code for "Theoretical Foundations of Deep Selective State-Space Models" (NeurIPS 2024)
  ☆15Updated 7 months ago
• dayal-kalra / low-memory-adam
  ☆11Updated 5 months ago
• TianjinYellow / SPAM-Optimizer
  ☆34Updated 5 months ago
• EleutherAI / nanoGPT-mup
  The simplest, fastest repository for training/finetuning medium-sized GPTs.
  ☆156Updated 2 months ago
• wesg52 / universal-neurons
  Universal Neurons in GPT2 Language Models
  ☆30Updated last year
• katiekang1998 / reasoning_generalization
  ☆34Updated 7 months ago
• dmis-lab / Monet
  [ICLR 2025] Monet: Mixture of Monosemantic Experts for Transformers
  ☆70Updated 2 months ago
• ruke1ire / RTF
  A State-Space Model with Rational Transfer Function Representation.
  ☆79Updated last year
• jopetty / word-problem
  Experiments on the impact of depth in transformers and SSMs.
  ☆33Updated 9 months ago
• JoshEngels / MultiDimensionalFeatures
  Code for reproducing our paper "Not All Language Model Features Are Linear"
  ☆77Updated 9 months ago