Alternatives and similar repositories for heinsen_sequence

Users that are interested in heinsen_sequence are comparing it to the libraries listed below

• johnryan465 / pscan
  ☆39Updated last year
• lixilinx / psgd_torch
  Pytorch implementation of preconditioned stochastic gradient descent (Kron and affine preconditioner, low-rank approximation precondition…
  ☆188Updated last month
• shikaiqiu / compute-better-spent
  ☆61Updated last year
• proger / accelerated-scan
  Accelerated First Order Parallel Associative Scan
  ☆192Updated last year
• athms / mad-lab
  A MAD laboratory to improve AI architecture designs 🧪
  ☆133Updated 11 months ago
• srush / triton-autodiff
  Experiment of using Tangent to autodiff triton
  ☆80Updated last year
• vvvm23 / mamba-jax
  Unofficial but Efficient Implementation of "Mamba: Linear-Time Sequence Modeling with Selective State Spaces" in JAX
  ☆89Updated last year
• dvruette / barrel-rec-pytorch
  ☆53Updated last year
• MatX-inc / seqax
  seqax = sequence modeling + JAX
  ☆168Updated 4 months ago
• proger / nanokitchen
  Parallel Associative Scan for Language Models
  ☆18Updated last year
• google-deepmind / nanodo
  ☆285Updated last year
• graphcore-research / unit-scaling
  A library for unit scaling in PyTorch
  ☆132Updated 4 months ago
• HazyResearch / train-tk
  train with kittens!
  ☆63Updated last year
• AndPotap / einsum-search
  ☆33Updated last year
• HazyResearch / zoology
  Understand and test language model architectures on synthetic tasks.
  ☆240Updated last month
• lxxue / prefix_sum
  A PyTorch wrapper of parallel exclusive scan in CUDA
  ☆12Updated 2 years ago
• lucidrains / gateloop-transformer
  Implementation of GateLoop Transformer in Pytorch and Jax
  ☆90Updated last year
• google-deepmind / spectral_ssm
  ☆34Updated last year
• modula-systems / modula
  🧱 Modula software package
  ☆303Updated 3 months ago
• ClashLuke / tpucare
  Automatically take good care of your preemptible TPUs
  ☆37Updated 2 years ago
• epfml / DenseFormer
  ☆82Updated last year
• HazyResearch / based
  Code for exploring Based models from "Simple linear attention language models balance the recall-throughput tradeoff"
  ☆243Updated 5 months ago
• BlinkDL / SmallInitEmb
  LayerNorm(SmallInit(Embedding)) in a Transformer to improve convergence
  ☆61Updated 3 years ago
• LucasPrietoAl / grokking-at-the-edge-of-numerical-stability
  ☆105Updated 3 months ago
• srush / do-we-need-attention
  ☆166Updated 2 years ago
• cloneofsimo / min-fsdp
  ☆91Updated last year
• jxiw / BiGS
  Official Repository of Pretraining Without Attention (BiGS), BiGS is the first model to achieve BERT-level transfer learning on the GLUE …
  ☆115Updated last year
• davisyoshida / lorax
  LoRA for arbitrary JAX models and functions
  ☆143Updated last year
• irhum / hyena
  JAX/Flax implementation of the Hyena Hierarchy
  ☆34Updated 2 years ago
• nikhilvyas / SOAP
  ☆223Updated 11 months ago