Alternatives and similar repositories for annotated-s4

Users that are interested in annotated-s4 are comparing it to the libraries listed below

• lindermanlab / S5
  ☆314Updated last year
• srush / annotated-mamba
  Annotated version of the Mamba paper
  ☆495Updated last year
• marin-community / levanter
  Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax
  ☆693Updated last week
• google / flaxformer
  ☆367Updated last year
• google-deepmind / nanodo
  ☆289Updated last year
• google-research / long-range-arena
  Long Range Arena for Benchmarking Efficient Transformers
  ☆776Updated 2 years ago
• HazyResearch / hippo-code
  ☆194Updated last year
• HazyResearch / H3
  Language Modeling with the H3 State Space Model
  ☆522Updated 2 years ago
• facebookresearch / optimizers
  For optimization algorithm research and development.
  ☆558Updated 3 weeks ago
• google-research / meliad
  ☆259Updated 7 months ago
• proger / accelerated-scan
  Accelerated First Order Parallel Associative Scan
  ☆196Updated 3 weeks ago
• kach / gradient-descent-the-ultimate-optimizer
  Code for our NeurIPS 2022 paper
  ☆371Updated 3 years ago
• facebookresearch / torchdim
  Named tensors with first-class dimensions for PyTorch
  ☆332Updated 2 years ago
• google-deepmind / neural_networks_chomsky_hierarchy
  Neural Networks and the Chomsky Hierarchy
  ☆212Updated last year
• ctlllll / SGConv
  ☆163Updated 3 years ago
• srush / Transformer-Puzzles
  Puzzles for exploring transformers
  ☆384Updated 2 years ago
• microsoft / mup
  maximal update parametrization (µP)
  ☆1,672Updated last year
• ayaka14732 / jax-smi
  JAX Synergistic Memory Inspector
  ☆184Updated last year
• facebookresearch / mega
  Sequence modeling with Mega.
  ☆303Updated 3 years ago
• lixilinx / psgd_torch
  Pytorch implementation of preconditioned stochastic gradient descent (Kron and affine preconditioner, low-rank approximation precondition…
  ☆191Updated 3 weeks ago
• PeaBrane / mamba-tiny
  Simple, minimal implementation of the Mamba SSM in one pytorch file. Using logcumsumexp (Heisen sequence).
  ☆130Updated last year
• srush / Autodiff-Puzzles
  ☆490Updated last year
• HomebrewML / HeavyBall
  Efficient optimizers
  ☆281Updated last month
• mlcommons / algorithmic-efficiency
  MLCommons Algorithmic Efficiency is a benchmark and competition measuring neural network training speedups due to algorithmic improvement…
  ☆406Updated this week
• KellerJordan / cifar10-airbench
  CIFAR-10 speedruns: 94% in 2.6 seconds and 96% in 27 seconds
  ☆349Updated 2 months ago
• samuela / git-re-basin
  Code release for "Git Re-Basin: Merging Models modulo Permutation Symmetries"
  ☆502Updated 2 years ago
• nikhilvyas / SOAP
  ☆246Updated last year
• HazyResearch / safari
  Convolutions for Sequence Modeling
  ☆910Updated last year
• lucidrains / st-moe-pytorch
  Implementation of ST-Moe, the latest incarnation of MoE after years of research at Brain, in Pytorch
  ☆378Updated last year
• BlackHC / neural_net_checklist
  ☆215Updated last year