Alternatives and similar repositories for 2023-transformers

Users that are interested in 2023-transformers are comparing it to the libraries listed below

• shikaiqiu / compute-better-spent
  ☆62Updated last year
• KindXiaoming / Omnigrok
  Omnigrok: Grokking Beyond Algorithmic Data
  ☆62Updated 2 years ago
• locuslab / edge-of-stability
  ☆73Updated last year
• vvvm23 / mamba-jax
  Unofficial but Efficient Implementation of "Mamba: Linear-Time Sequence Modeling with Selective State Spaces" in JAX
  ☆92Updated 2 years ago
• LIONS-EPFL / scion
  ☆52Updated last month
• machine-discovery / deer
  Parallelizing non-linear sequential models over the sequence length
  ☆56Updated 7 months ago
• AndPotap / einsum-search
  ☆33Updated last year
• lixilinx / psgd_torch
  Pytorch implementation of preconditioned stochastic gradient descent (Kron and affine preconditioner, low-rank approximation precondition…
  ☆191Updated 3 weeks ago
• thjashin / multires-conv
  Sequence Modeling with Multiresolution Convolutional Memory (ICML 2023)
  ☆127Updated 2 years ago
• formll / dog
  DoG is SGD's Best Friend: A Parameter-Free Dynamic Step Size Schedule
  ☆64Updated 2 years ago
• bhoov / energy-transformer-jax
  The Energy Transformer block, in JAX
  ☆63Updated 2 years ago
• ruke1ire / RTF
  A State-Space Model with Rational Transfer Function Representation.
  ☆83Updated last year
• danielmamay / grokking
  Implementation of OpenAI's 'Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets' paper.
  ☆42Updated 2 years ago
• athms / mad-lab
  A MAD laboratory to improve AI architecture designs 🧪
  ☆135Updated last year
• Sea-Snell / grokking
  unofficial re-implementation of "Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets"
  ☆83Updated 3 years ago
• requeima / llm_processes
  ☆69Updated 10 months ago
• jongharyu / neural-svd
  Official PyTorch implementation of NeuralSVD (ICML 2024)
  ☆22Updated last year
• chengxiang / LinearTransformer
  Pytorch code for experiments on Linear Transformers
  ☆25Updated 2 years ago
• nikhilvyas / SOAP
  ☆238Updated last year
• epfml / llm-baselines
  nanoGPT-like codebase for LLM training
  ☆113Updated 2 months ago
• michaelsdr / sinkformers
  Transformers with doubly stochastic attention
  ☆53Updated 3 years ago
• Lemon-cmd / energy-transformer-graph
  This repository contains the official code for Energy Transformer---an efficient Energy-based Transformer variant for graph classificatio…
  ☆25Updated 2 years ago
• sustcsonglin / flash-linear-rnn
  Implementations of various linear RNN layers using pytorch and triton
  ☆54Updated 2 years ago
• facebookresearch / w2ot
  Euclidean Wasserstein-2 optimal transportation
  ☆47Updated 2 years ago
• Ping-C / optimizer
  This repository includes code to reproduce the tables in "Loss Landscapes are All You Need: Neural Network Generalization Can Be Explaine…
  ☆40Updated 2 years ago
• thudzj / ELLA
  Code for Accelerated Linearized Laplace Approximation for Bayesian Deep Learning (ELLA, NeurIPS 22')
  ☆17Updated 3 years ago
• DeqingFu / transformers-icl-second-order
  Official repository for our paper, Transformers Learn Higher-Order Optimization Methods for In-Context Learning: A Study with Linear Mode…
  ☆20Updated last year
• bremen79 / parameterfree
  Parameter-Free Optimizers for Pytorch
  ☆130Updated last year
• berlino / seq_icl
  ☆53Updated last year
• mechanistic-interpretability-grokking / progress-measures-paper
  ☆76Updated 3 years ago