Alternatives and similar repositories for mamba-jax:

Users that are interested in mamba-jax are comparing it to the libraries listed below

• radarFudan / mamba-minimal-jax
  ☆30Updated 4 months ago
• shikaiqiu / compute-better-spent
  ☆52Updated 6 months ago
• google-deepmind / spectral_ssm
  ☆31Updated 11 months ago
• lucidrains / gateloop-transformer
  Implementation of GateLoop Transformer in Pytorch and Jax
  ☆87Updated 9 months ago
• johnryan465 / pscan
  ☆39Updated last year
• evanatyourservice / psgd_jax
  Implementation of PSGD optimizer in JAX
  ☆30Updated 3 months ago
• ruke1ire / RTF
  A State-Space Model with Rational Transfer Function Representation.
  ☆78Updated 10 months ago
• phlippe / jax_trainer
  Lightning-like training API for JAX with Flax
  ☆38Updated 3 months ago
• jopetty / word-problem
  Experiments on the impact of depth in transformers and SSMs.
  ☆23Updated 4 months ago
• EleutherAI / rnngineering
  Engineering the state of RNN language models (Mamba, RWKV, etc.)
  ☆32Updated 10 months ago
• srush / mamba-scans
  Blog post
  ☆17Updated last year
• epfml / DenseFormer
  ☆79Updated 11 months ago
• AndPotap / einsum-search
  ☆30Updated 5 months ago
• jax-ml / jax-llm-examples
  ☆87Updated 3 weeks ago
• thjashin / multires-conv
  Sequence Modeling with Multiresolution Convolutional Memory (ICML 2023)
  ☆122Updated last year
• cgarciae / nanoGPT-jax
  The simplest, fastest repository for training/finetuning medium-sized GPTs.
  ☆32Updated last year
• srush / mamba-primer
  ☆37Updated 11 months ago
• davisyoshida / lorax
  LoRA for arbitrary JAX models and functions
  ☆135Updated last year
• young-geng / mintext
  Minimal but scalable implementation of large language models in JAX
  ☆34Updated 5 months ago
• machine-discovery / deer
  Parallelizing non-linear sequential models over the sequence length
  ☆51Updated 2 months ago
• ethansmith2000 / fsdp_optimizers
  supporting pytorch FSDP for optimizers
  ☆80Updated 3 months ago
• BlinkDL / SmallInitEmb
  LayerNorm(SmallInit(Embedding)) in a Transformer to improve convergence
  ☆60Updated 3 years ago
• lucidrains / GAF-microbatch-pytorch
  Implementation of Gradient Agreement Filtering, from Chaubard et al. of Stanford, but for single machine microbatches, in Pytorch
  ☆23Updated 2 months ago
• GallagherCommaJack / modulax
  ☆17Updated 7 months ago
• ag1988 / dss
  Sequence Modeling with Structured State Spaces
  ☆63Updated 2 years ago
• proger / nanokitchen
  Parallel Associative Scan for Language Models
  ☆18Updated last year
• BirkhoffG / jax-dataloader
  Pytorch-like dataloaders for JAX.
  ☆77Updated 5 months ago
• amirzandieh / HyperAttention
  Triton Implementation of HyperAttention Algorithm
  ☆47Updated last year
• lucidrains / kalman-filtering-attention
  Implementation of the Kalman Filtering Attention proposed in "Kalman Filtering Attention for User Behavior Modeling in CTR Prediction"
  ☆57Updated last year
• dlwh / jax_sourceror
  Turn jitted jax functions back into python source code
  ☆22Updated 3 months ago