Alternatives and similar repositories for 2023-transformers

Users that are interested in 2023-transformers are comparing it to the libraries listed below

• KindXiaoming / Omnigrok
  Omnigrok: Grokking Beyond Algorithmic Data
  ☆62Updated 2 years ago
• shikaiqiu / compute-better-spent
  ☆62Updated last year
• nikhilvyas / SOAP
  ☆227Updated last year
• AndPotap / einsum-search
  ☆33Updated last year
• Sea-Snell / grokking
  unofficial re-implementation of "Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets"
  ☆80Updated 3 years ago
• athms / mad-lab
  A MAD laboratory to improve AI architecture designs 🧪
  ☆135Updated 11 months ago
• formll / dog
  DoG is SGD's Best Friend: A Parameter-Free Dynamic Step Size Schedule
  ☆63Updated 2 years ago
• locuslab / edge-of-stability
  ☆73Updated last year
• LIONS-EPFL / scion
  ☆49Updated last month
• machine-discovery / deer
  Parallelizing non-linear sequential models over the sequence length
  ☆56Updated 5 months ago
• borjanG / 2023-transformers-rotf
  Codes for the paper "A mathematical perspective on Transformers".
  ☆39Updated last year
• berlino / seq_icl
  ☆53Updated last year
• michaelsdr / sinkformers
  Transformers with doubly stochastic attention
  ☆50Updated 3 years ago
• lixilinx / psgd_torch
  Pytorch implementation of preconditioned stochastic gradient descent (Kron and affine preconditioner, low-rank approximation precondition…
  ☆188Updated this week
• ruke1ire / RTF
  A State-Space Model with Rational Transfer Function Representation.
  ☆83Updated last year
• vvvm23 / mamba-jax
  Unofficial but Efficient Implementation of "Mamba: Linear-Time Sequence Modeling with Selective State Spaces" in JAX
  ☆92Updated last year
• JunLi-Galios / Optimization-on-Stiefel-Manifold-via-Cayley-Transform
  Efficient Riemannian Optimization on Stiefel Manifold via Cayley Transform
  ☆43Updated 6 years ago
• zyushun / hessian-spectrum
  Code for the paper: Why Transformers Need Adam: A Hessian Perspective
  ☆63Updated 9 months ago
• sail-sg / stde
  Official implementation of Stochastic Taylor Derivative Estimator (STDE) NeurIPS2024
  ☆124Updated last year
• sustcsonglin / flash-linear-rnn
  Implementations of various linear RNN layers using pytorch and triton
  ☆54Updated 2 years ago
• google-deepmind / spectral_ssm
  ☆34Updated last year
• DeqingFu / transformers-icl-second-order
  Official repository for our paper, Transformers Learn Higher-Order Optimization Methods for In-Context Learning: A Study with Linear Mode…
  ☆20Updated last year
• lindermanlab / elk
  Scalable and Stable Parallelization of Nonlinear RNNS
  ☆27Updated last month
• ejmichaud / grokking-squared
  ☆27Updated 2 years ago
• thjashin / multires-conv
  Sequence Modeling with Multiresolution Convolutional Memory (ICML 2023)
  ☆127Updated 2 years ago
• requeima / llm_processes
  ☆67Updated 8 months ago
• necludov / wl-mechanics
  ☆31Updated last year
• bhoov / energy-transformer-jax
  The Energy Transformer block, in JAX
  ☆62Updated 2 years ago
• adamkarvonen / SAE_BoardGameEval
  ☆23Updated 10 months ago
• Bond1995 / Markov
  Code for experiments on transformers using Markovian data.
  ☆21Updated last year