Alternatives and similar repositories for 2023-transformers

Users that are interested in 2023-transformers are comparing it to the libraries listed below

• KindXiaoming / Omnigrok
  Omnigrok: Grokking Beyond Algorithmic Data
  ☆62Updated 2 years ago
• shikaiqiu / compute-better-spent
  ☆62Updated last year
• nikhilvyas / SOAP
  ☆234Updated last year
• AndPotap / einsum-search
  ☆33Updated last year
• GallagherCommaJack / modulax
  ☆18Updated last year
• locuslab / edge-of-stability
  ☆73Updated last year
• formll / dog
  DoG is SGD's Best Friend: A Parameter-Free Dynamic Step Size Schedule
  ☆63Updated 2 years ago
• athms / mad-lab
  A MAD laboratory to improve AI architecture designs 🧪
  ☆136Updated last year
• michaelsdr / sinkformers
  Transformers with doubly stochastic attention
  ☆51Updated 3 years ago
• LIONS-EPFL / scion
  ☆52Updated 3 weeks ago
• thjashin / multires-conv
  Sequence Modeling with Multiresolution Convolutional Memory (ICML 2023)
  ☆127Updated 2 years ago
• vvvm23 / mamba-jax
  Unofficial but Efficient Implementation of "Mamba: Linear-Time Sequence Modeling with Selective State Spaces" in JAX
  ☆92Updated last year
• machine-discovery / deer
  Parallelizing non-linear sequential models over the sequence length
  ☆56Updated 6 months ago
• requeima / llm_processes
  ☆69Updated 9 months ago
• sail-sg / stde
  Official implementation of Stochastic Taylor Derivative Estimator (STDE) NeurIPS2024
  ☆125Updated last year
• ejmichaud / grokking-squared
  ☆27Updated 2 years ago
• alisiahkoohi / Langevin-dynamics
  Sampling with gradient-based Markov Chain Monte Carlo approaches
  ☆108Updated last year
• Sea-Snell / grokking
  unofficial re-implementation of "Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets"
  ☆81Updated 3 years ago
• bremen79 / parameterfree
  Parameter-Free Optimizers for Pytorch
  ☆130Updated last year
• GFNOrg / EB_GFN
  Code for our paper "Generative Flow Networks for Discrete Probabilistic Modeling"
  ☆87Updated 2 years ago
• edwardjhu / TP4
  Code accompanying our paper "Feature Learning in Infinite-Width Neural Networks" (https://arxiv.org/abs/2011.14522)
  ☆63Updated 4 years ago
• lixilinx / psgd_torch
  Pytorch implementation of preconditioned stochastic gradient descent (Kron and affine preconditioner, low-rank approximation precondition…
  ☆188Updated 2 weeks ago
• bhoov / energy-transformer-jax
  The Energy Transformer block, in JAX
  ☆63Updated 2 years ago
• phlippe / jax_trainer
  Lightning-like training API for JAX with Flax
  ☆45Updated last year
• epfml / llm-baselines
  nanoGPT-like codebase for LLM training
  ☆114Updated 2 months ago
• facebookresearch / w2ot
  Euclidean Wasserstein-2 optimal transportation
  ☆47Updated 2 years ago
• lindermanlab / elk
  Scalable and Stable Parallelization of Nonlinear RNNS
  ☆28Updated 2 months ago
• EleutherAI / nanoGPT-mup
  The simplest, fastest repository for training/finetuning medium-sized GPTs.
  ☆181Updated 6 months ago
• borjanG / 2023-transformers-rotf
  Codes for the paper "A mathematical perspective on Transformers".
  ☆39Updated last year
• chengxiang / LinearTransformer
  Pytorch code for experiments on Linear Transformers
  ☆25Updated last year