Alternatives and similar repositories for xlstm-jax:

Users that are interested in xlstm-jax are comparing it to the libraries listed below

• nikhilvyas / SOAP
  ☆146Updated last month
• nanowell / AdEMAMix-Optimizer-Pytorch
  The AdEMAMix Optimizer: Better, Faster, Older.
  ☆178Updated 4 months ago
• KellerJordan / Muon
  Muon optimizer for neural networks: >30% extra sample efficiency, <3% wallclock overhead
  ☆210Updated 2 weeks ago
• EleutherAI / nanoGPT-mup
  The simplest, fastest repository for training/finetuning medium-sized GPTs.
  ☆90Updated 2 months ago
• ethansmith2000 / fsdp_optimizers
  supporting pytorch FSDP for optimizers
  ☆75Updated last month
• jzhang38 / LongMamba
  Some preliminary explorations of Mamba's context scaling.
  ☆206Updated 11 months ago
• ruke1ire / RTF
  A State-Space Model with Rational Transfer Function Representation.
  ☆76Updated 8 months ago
• modula-systems / modula
  🧱 Modula software package
  ☆132Updated this week
• PeaBrane / mamba-tiny
  Simple, minimal implementation of the Mamba SSM in one pytorch file. Using logcumsumexp (Heisen sequence).
  ☆105Updated 3 months ago
• NVIDIA / ngpt
  Normalized Transformer (nGPT)
  ☆145Updated 2 months ago
• athms / mad-lab
  A MAD laboratory to improve AI architecture designs 🧪
  ☆102Updated last month
• HazyResearch / zoology
  Understand and test language model architectures on synthetic tasks.
  ☆175Updated this week
• proger / accelerated-scan
  Accelerated First Order Parallel Associative Scan
  ☆169Updated 5 months ago
• lindermanlab / S5
  ☆276Updated last week
• apple / ml-sigma-reparam
  ☆296Updated 6 months ago
• AvivBick / awesome-ssm-ml
  Reading list for research topics in state-space models
  ☆254Updated 3 weeks ago
• BlackHC / neural_net_checklist
  ☆149Updated 5 months ago
• cloneofsimo / scaling-guide
  WIP
  ☆92Updated 5 months ago
• alxndrTL / othello_mamba
  Evaluating the Mamba architecture on the Othello game
  ☆44Updated 8 months ago
• bloc97 / DeMo
  DeMo: Decoupled Momentum Optimization
  ☆171Updated last month
• kuleshov-group / mdlm
  Simplified Masked Diffusion Language Model
  ☆251Updated last month
• google-deepmind / nanodo
  ☆201Updated 6 months ago
• apple / ml-sigmoid-attention
  ☆241Updated 4 months ago
• facebookresearch / memory
  Memory layers use a trainable key-value lookup mechanism to add extra parameters to a model without increasing FLOPs. Conceptually, spars…
  ☆278Updated last month
• lucidrains / minGRU-pytorch
  Implementation of the proposed minGRU in Pytorch
  ☆272Updated last month
• Zyphra / Zamba2
  PyTorch implementation of models from the Zamba2 series.
  ☆168Updated last month
• KellerJordan / cifar10-airbench
  94% on CIFAR-10 in 2.6 seconds 💨 96% in 27 seconds
  ☆195Updated last month
• ClashLuke / HeavyBall
  Efficient optimizers
  ☆145Updated this week
• shikaiqiu / compute-better-spent
  ☆50Updated 3 months ago
• lucidrains / nGPT-pytorch
  Quick implementation of nGPT, learning entirely on the hypersphere, from NvidiaAI
  ☆270Updated 2 months ago