Alternatives and similar repositories for AdaFisher

Users that are interested in AdaFisher are comparing it to the libraries listed below

• sail-sg / win
  ☆9Updated 2 years ago
• apapiu / mamba_small_bench
  Trying out the Mamba architecture on small examples (cifar-10, shakespeare char level etc.)
  ☆47Updated last year
• lucidrains / adam-atan2-pytorch
  Implementation of the proposed Adam-atan2 from Google Deepmind in Pytorch
  ☆110Updated 7 months ago
• Adamdad / rational_kat_cu
  ☆69Updated 5 months ago
• AmeenAli / HiddenMambaAttn
  Official PyTorch Implementation of "The Hidden Attention of Mamba Models"
  ☆224Updated last year
• TianjinYellow / SPAM-Optimizer
  ☆33Updated 4 months ago
• tommyip / mamba2-minimal
  Minimal Mamba-2 implementation in PyTorch
  ☆207Updated last year
• kozistr / pytorch_optimizer
  optimizer & lr scheduler & loss function collections in PyTorch
  ☆310Updated last week
• kyegomez / MambaTransformer
  Integrating Mamba/SSMs with Transformer for Enhanced Long Context and High-Quality Sequence Modeling
  ☆197Updated 3 months ago
• nikhilvyas / SOAP
  ☆197Updated 7 months ago
• nanowell / AdEMAMix-Optimizer-Pytorch
  The AdEMAMix Optimizer: Better, Faster, Older.
  ☆183Updated 10 months ago
• kyegomez / Griffin
  Implementation of Griffin from the paper: "Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models"
  ☆55Updated 3 months ago
• goombalab / hydra
  Official implementation of "Hydra: Bidirectional State Space Models Through Generalized Matrix Mixers"
  ☆144Updated 5 months ago
• lucidrains / agent-attention-pytorch
  Implementation of Agent Attention in Pytorch
  ☆90Updated last year
• MambaMixer / M2
  ☆47Updated last year
• kyleliang919 / C-Optim
  When it comes to optimizers, it's always better to be safe than sorry
  ☆302Updated 3 months ago
• Hprairie / Bi-Mamba2
  A Triton Kernel for incorporating Bi-Directionality in Mamba2
  ☆71Updated 6 months ago
• opooladz / Preconditioned-Stochastic-Gradient-Descent
  A repo based on XiLin Li's PSGD repo that extends some of the experiments.
  ☆14Updated 9 months ago
• lucidrains / hl-gauss-pytorch
  The Gaussian Histogram Loss (HL-Gauss) proposed by Imani et al. with a few convenient wrappers for regression, in Pytorch
  ☆65Updated last month
• lucidrains / hyper-connections
  Attempt to make multiple residual streams from Bytedance's Hyper-Connections paper accessible to the public
  ☆87Updated last month
• lessw2020 / FAdam_PyTorch
  an implementation of FAdam (Fisher Adam) in PyTorch
  ☆47Updated 2 weeks ago
• badripatro / mamba360
  State Space Models
  ☆68Updated last year
• zqOuO / GWT
  ☆13Updated 6 months ago
• MzeroMiko / mamba-mini
  An efficient pytorch implementation of selective scan in one file, works with both cpu and gpu, with corresponding mathematical derivatio…
  ☆93Updated last year
• FarnoushRJ / MambaLRP
  [NeurIPS 2024] Official implementation of the paper "MambaLRP: Explaining Selective State Space Sequence Models".
  ☆41Updated 8 months ago
• fkodom / yet-another-retnet
  A simple but robust PyTorch implementation of RetNet from "Retentive Network: A Successor to Transformer for Large Language Models" (http…
  ☆106Updated last year
• lucidrains / infini-transformer-pytorch
  Implementation of Infini-Transformer in Pytorch
  ☆111Updated 6 months ago
• lucidrains / soft-moe-pytorch
  Implementation of Soft MoE, proposed by Brain's Vision team, in Pytorch
  ☆304Updated 3 months ago
• nblt / F-SAM
  [CVPR 2024] Friendly Sharpness-Aware Minimization
  ☆33Updated 8 months ago
• lucidrains / gradnorm-pytorch
  A practical implementation of GradNorm, Gradient Normalization for Adaptive Loss Balancing, in Pytorch
  ☆99Updated last year