lxxue / prefix_sum

Related projects: ⓘ

• johnryan465 / pscan
  ☆33Updated 8 months ago
• machine-discovery / deer
  Parallelizing non-linear sequential models over the sequence length
  ☆40Updated last month
• maximzubkov / fft-scan
  Efficient PScan implementation in PyTorch
  ☆15Updated 8 months ago
• thjashin / multires-conv
  Sequence Modeling with Multiresolution Convolutional Memory (ICML 2023)
  ☆119Updated 11 months ago
• srush / mamba-scans
  Blog post
  ☆16Updated 7 months ago
• shikaiqiu / compute-better-spent
  ☆42Updated 3 months ago
• sustcsonglin / mamba-triton
  ☆42Updated 7 months ago
• radarFudan / mamba-minimal-jax
  ☆28Updated last week
• sustcsonglin / flash-linear-rnn
  Implementations of various linear RNN layers using pytorch and triton
  ☆42Updated last year
• proger / accelerated-scan
  Accelerated First Order Parallel Associative Scan
  ☆151Updated last month
• proger / nanokitchen
  Parallel Associative Scan for Language Models
  ☆16Updated 8 months ago
• NicolasZucchet / minimal-LRU
  Non official implementation of the Linear Recurrent Unit (LRU, Orvieto et al. 2023)
  ☆47Updated 7 months ago
• ag1988 / dss
  Sequence Modeling with Structured State Spaces
  ☆60Updated 2 years ago
• OpenNLPLab / HGRN
  [NeurIPS 2023 spotlight] Official implementation of HGRN in our NeurIPS 2023 paper - Hierarchically Gated Recurrent Neural Network for Se…
  ☆60Updated 4 months ago
• lucidrains / gateloop-transformer
  Implementation of GateLoop Transformer in Pytorch and Jax
  ☆86Updated 3 months ago
• glassroom / heinsen_attention
  Reference implementation of "Softmax Attention with Constant Cost per Token" (Heinsen, 2024)
  ☆22Updated 3 months ago
• sustcsonglin / gated_linear_attention_layer
  ☆30Updated 8 months ago
• tml-epfl / why-weight-decay
  Why Do We Need Weight Decay in Modern Deep Learning? [arXiv, Oct 2023]
  ☆41Updated 11 months ago
• vvvm23 / mamba-jax
  Unofficial but Efficient Implementation of "Mamba: Linear-Time Sequence Modeling with Selective State Spaces" in JAX
  ☆74Updated 7 months ago
• google-deepmind / spectral_ssm
  ☆25Updated 5 months ago
• ruke1ire / RTF
  A State-Space Model with Rational Transfer Function Representation.
  ☆61Updated 4 months ago
• srush / triton-autodiff
  Experiment of using Tangent to autodiff triton
  ☆66Updated 7 months ago
• berlino / seq_icl
  ☆48Updated 4 months ago
• Doraemonzzz / hgru-pytorch
  ☆24Updated 2 months ago
• tobiaskatsch / GatedLinearRNN
  ☆23Updated 6 months ago
• BlinkDL / LinearAttentionArena
  Here we will test various linear attention designs.
  ☆55Updated 4 months ago
• glassroom / heinsen_sequence
  Code implementing "Efficient Parallelization of a Ubiquitious Sequential Computation" (Heinsen, 2023)
  ☆74Updated 8 months ago
• lucidrains / autoregressive-linear-attention-cuda
  CUDA implementation of autoregressive linear attention, with all the latest research findings
  ☆43Updated last year
• srush / mamba-primer
  ☆35Updated 5 months ago
• lixilinx / psgd_torch
  Pytorch implementation of preconditioned stochastic gradient descent (affine group preconditioner, low-rank approximation preconditioner …
  ☆105Updated this week