Alternatives and similar repositories for 2023-transformers

Users that are interested in 2023-transformers are comparing it to the libraries listed below

• KindXiaoming / Omnigrok
  Omnigrok: Grokking Beyond Algorithmic Data
  ☆62Updated 2 years ago
• vvvm23 / mamba-jax
  Unofficial but Efficient Implementation of "Mamba: Linear-Time Sequence Modeling with Selective State Spaces" in JAX
  ☆88Updated last year
• Sea-Snell / grokking
  unofficial re-implementation of "Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets"
  ☆79Updated 3 years ago
• locuslab / edge-of-stability
  ☆71Updated 10 months ago
• AndPotap / einsum-search
  ☆33Updated last year
• lixilinx / psgd_torch
  Pytorch implementation of preconditioned stochastic gradient descent (Kron and affine preconditioner, low-rank approximation precondition…
  ☆188Updated 2 weeks ago
• formll / dog
  DoG is SGD's Best Friend: A Parameter-Free Dynamic Step Size Schedule
  ☆63Updated 2 years ago
• borjanG / 2023-transformers-rotf
  Codes for the paper "A mathematical perspective on Transformers".
  ☆39Updated last year
• machine-discovery / deer
  Parallelizing non-linear sequential models over the sequence length
  ☆54Updated 4 months ago
• shikaiqiu / compute-better-spent
  ☆60Updated last year
• thudzj / ELLA
  Code for Accelerated Linearized Laplace Approximation for Bayesian Deep Learning (ELLA, NeurIPS 22')
  ☆16Updated 3 years ago
• wesg52 / universal-neurons
  Universal Neurons in GPT2 Language Models
  ☆30Updated last year
• NicolasZucchet / minimal-LRU
  Non official implementation of the Linear Recurrent Unit (LRU, Orvieto et al. 2023)
  ☆58Updated 2 months ago
• LIONS-EPFL / scion
  ☆45Updated 2 weeks ago
• ejmichaud / grokking-squared
  ☆27Updated 2 years ago
• nikhilvyas / SOAP
  ☆220Updated 11 months ago
• chengxiang / LinearTransformer
  Pytorch code for experiments on Linear Transformers
  ☆23Updated last year
• requeima / llm_processes
  ☆66Updated 7 months ago
• DeqingFu / transformers-icl-second-order
  Official repository for our paper, Transformers Learn Higher-Order Optimization Methods for In-Context Learning: A Study with Linear Mode…
  ☆19Updated 11 months ago
• michaelsdr / sinkformers
  Transformers with doubly stochastic attention
  ☆49Updated 3 years ago
• jongharyu / neural-svd
  Official PyTorch implementation of NeuralSVD (ICML 2024)
  ☆20Updated last year
• sail-sg / stde
  Official implementation of Stochastic Taylor Derivative Estimator (STDE) NeurIPS2024
  ☆122Updated 11 months ago
• wattenberg / superposition
  Code associated to papers on superposition (in ML interpretability)
  ☆33Updated 3 years ago
• danielmamay / grokking
  Implementation of OpenAI's 'Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets' paper.
  ☆39Updated 2 years ago
• google-deepmind / spectral_ssm
  ☆34Updated last year
• berlino / seq_icl
  ☆53Updated last year
• athms / mad-lab
  A MAD laboratory to improve AI architecture designs 🧪
  ☆132Updated 10 months ago
• teddykoker / grokking
  PyTorch implementation of "Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets"
  ☆38Updated 3 years ago
• johnryan465 / pscan
  ☆39Updated last year
• srush / mamba-scans
  Blog post
  ☆17Updated last year