Alternatives and similar repositories for 2023-transformers

Users that are interested in 2023-transformers are comparing it to the libraries listed below

• locuslab / edge-of-stability
  ☆73Updated last year
• KindXiaoming / Omnigrok
  Omnigrok: Grokking Beyond Algorithmic Data
  ☆62Updated 2 years ago
• machine-discovery / deer
  Parallelizing non-linear sequential models over the sequence length
  ☆56Updated 7 months ago
• shikaiqiu / compute-better-spent
  ☆62Updated last year
• michaelsdr / sinkformers
  Transformers with doubly stochastic attention
  ☆53Updated 3 years ago
• danielmamay / grokking
  Implementation of OpenAI's 'Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets' paper.
  ☆42Updated 2 years ago
• lixilinx / psgd_torch
  Pytorch implementation of preconditioned stochastic gradient descent (Kron and affine preconditioner, low-rank approximation precondition…
  ☆190Updated last month
• jongharyu / neural-svd
  Official PyTorch implementation of NeuralSVD (ICML 2024)
  ☆22Updated last year
• vvvm23 / mamba-jax
  Unofficial but Efficient Implementation of "Mamba: Linear-Time Sequence Modeling with Selective State Spaces" in JAX
  ☆93Updated 2 years ago
• formll / dog
  DoG is SGD's Best Friend: A Parameter-Free Dynamic Step Size Schedule
  ☆64Updated 2 years ago
• thjashin / multires-conv
  Sequence Modeling with Multiresolution Convolutional Memory (ICML 2023)
  ☆127Updated 2 years ago
• AndPotap / einsum-search
  ☆33Updated last year
• LIONS-EPFL / scion
  ☆53Updated last month
• nikhilvyas / SOAP
  ☆250Updated last year
• athms / mad-lab
  A MAD laboratory to improve AI architecture designs 🧪
  ☆138Updated last year
• sustcsonglin / flash-linear-rnn
  Implementations of various linear RNN layers using pytorch and triton
  ☆54Updated 2 years ago
• JunLi-Galios / Optimization-on-Stiefel-Manifold-via-Cayley-Transform
  Efficient Riemannian Optimization on Stiefel Manifold via Cayley Transform
  ☆44Updated 6 years ago
• bremen79 / parameterfree
  Parameter-Free Optimizers for Pytorch
  ☆130Updated last year
• thudzj / ELLA
  Code for Accelerated Linearized Laplace Approximation for Bayesian Deep Learning (ELLA, NeurIPS 22')
  ☆17Updated 3 years ago
• Sea-Snell / grokking
  unofficial re-implementation of "Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets"
  ☆83Updated 3 years ago
• chengxiang / LinearTransformer
  Pytorch code for experiments on Linear Transformers
  ☆24Updated 2 years ago
• edwardjhu / TP4
  Code accompanying our paper "Feature Learning in Infinite-Width Neural Networks" (https://arxiv.org/abs/2011.14522)
  ☆62Updated 4 years ago
• RobertCsordas / onion_representations
  ☆13Updated last year
• nocotan / awesome-information-geometry
  About A collection of AWESOME things about information geometry Topics
  ☆180Updated last year
• abietti / transformer-birth
  ☆19Updated 2 years ago
• GFNOrg / EB_GFN
  Code for our paper "Generative Flow Networks for Discrete Probabilistic Modeling"
  ☆87Updated 2 years ago
• srush / mamba-scans
  Blog post
  ☆17Updated last year
• NicolasZucchet / minimal-LRU
  Non official implementation of the Linear Recurrent Unit (LRU, Orvieto et al. 2023)
  ☆61Updated 5 months ago
• ruqizhang / discrete-langevin
  ☆42Updated 3 years ago
• thegregyang / NTK4A
  Code for the paper: "Tensor Programs II: Neural Tangent Kernel for Any Architecture"
  ☆109Updated 5 years ago