Alternatives and similar repositories for llama-titans

Users that are interested in llama-titans are comparing it to the libraries listed below

• meulemansalex / theoretical_framework_for_target_propagation
  Python implementation of the methods in Meulemans et al. 2020 - A Theoretical Framework For Target Propagation
  ☆32Updated 8 months ago
• liukidar / pcx
  Predictive Coding JAX-based library
  ☆76Updated 2 months ago
• machine-discovery / deer
  Parallelizing non-linear sequential models over the sequence length
  ☆52Updated 3 weeks ago
• Cranial-XIX / longhorn
  Official PyTorch Implementation of the Longhorn Deep State Space Model
  ☆53Updated 7 months ago
• EPFL-LCN / pub-illing2021-neurips
  Public code for Illing, Ventura, Bellec & Gerstner 2021: Local plasticity rules can learn deep representations using self-supervised cont…
  ☆24Updated last year
• wesg52 / universal-neurons
  Universal Neurons in GPT2 Language Models
  ☆30Updated last year
• Leiay / looped_transformer
  ☆28Updated last year
• autonomousvision / akorn
  [ICLR'25] Artificial Kuramoto Oscillatory Neurons
  ☆94Updated last month
• goombalab / phi-mamba
  Official implementation of Phi-Mamba. A MOHAWK-distilled model (Transformers to SSMs: Distilling Quadratic Knowledge to Subquadratic Mode…
  ☆110Updated 10 months ago
• jysohn1108 / Looped-Transformer
  Official implementation of the transformer (TF) architecture suggested in a paper entitled "Looped Transformers as Programmable Computers…
  ☆27Updated 2 years ago
• zqOuO / GWT
  ☆13Updated 6 months ago
• ago109 / predictive-forward-forward
  Implementation/simulation of the predictive forward-forward credit assignment algorithm for training neurobiologically-plausible recurren…
  ☆60Updated 2 years ago
• jsalbert / biotorch
  BioTorch is a PyTorch framework specializing in biologically plausible learning algorithms
  ☆50Updated last year
• alxndrTL / othello_mamba
  Evaluating the Mamba architecture on the Othello game
  ☆47Updated last year
• shikaiqiu / compute-better-spent
  ☆53Updated 9 months ago
• Gothos / LRU-pytorch
  Unofficial implementation of Linear Recurrent Units, by Deepmind, in Pytorch
  ☆70Updated 2 months ago
• fangyuan-ksgk / selective-attention-transformer
  Unofficial Implementation of Selective Attention Transformer
  ☆17Updated 8 months ago
• IdoAmos / not-from-scratch
  ☆32Updated 8 months ago
• convergence-ai / lm2
  Official repo of paper LM2
  ☆41Updated 5 months ago
• huyphan168 / PEER
  Mixture of A Million Experts
  ☆46Updated 11 months ago
• dayal-kalra / low-memory-adam
  ☆11Updated 4 months ago
• proger / hippogriff
  Griffin MQA + Hawk Linear RNN Hybrid
  ☆87Updated last year
• athms / mad-lab
  A MAD laboratory to improve AI architecture designs 🧪
  ☆123Updated 7 months ago
• a-antoniades / Neuroformer
  ☆38Updated 4 months ago
• EleutherAI / nanoGPT-mup
  The simplest, fastest repository for training/finetuning medium-sized GPTs.
  ☆147Updated 3 weeks ago
• OpenNLPLab / HGRN2
  HGRN2: Gated Linear RNNs with State Expansion
  ☆55Updated 11 months ago
• facebookresearch / MemoryMosaics
  Memory Mosaics are networks of associative memories working in concert to achieve a prediction task.
  ☆46Updated 5 months ago
• shawntan / stickbreaking-attention
  Stick-breaking attention
  ☆58Updated 2 weeks ago
• NicolasZucchet / Online-learning-LR-dependencies
  Implementation of the "Online learning of long-range dependencies" paper, NeurIPS 2023
  ☆18Updated 8 months ago
• test-time-training / ttt-lm-kernels
  Inference Speed Benchmark for Learning to (Learn at Test Time): RNNs with Expressive Hidden States
  ☆72Updated last year