Alternatives and similar repositories for prefix_sum

Users that are interested in prefix_sum are comparing it to the libraries listed below

• johnryan465 / pscan
  ☆40Updated 2 years ago
• proger / nanokitchen
  Parallel Associative Scan for Language Models
  ☆18Updated 2 years ago
• thjashin / multires-conv
  Sequence Modeling with Multiresolution Convolutional Memory (ICML 2023)
  ☆127Updated 2 years ago
• proger / accelerated-scan
  Accelerated First Order Parallel Associative Scan
  ☆192Updated last week
• maximzubkov / fft-scan
  Efficient PScan implementation in PyTorch
  ☆17Updated 2 years ago
• sustcsonglin / flash-linear-rnn
  Implementations of various linear RNN layers using pytorch and triton
  ☆54Updated 2 years ago
• eamartin / parallelizing_linear_rnns
  ☆45Updated 7 years ago
• sustcsonglin / gated_linear_attention_layer
  ☆32Updated 2 years ago
• glassroom / heinsen_sequence
  Code implementing "Efficient Parallelization of a Ubiquitious Sequential Computation" (Heinsen, 2023)
  ☆98Updated last year
• shikaiqiu / compute-better-spent
  ☆62Updated last year
• AndPotap / einsum-search
  ☆33Updated last year
• tml-epfl / why-weight-decay
  Why Do We Need Weight Decay in Modern Deep Learning? [NeurIPS 2024]
  ☆70Updated last year
• machine-discovery / deer
  Parallelizing non-linear sequential models over the sequence length
  ☆56Updated 6 months ago
• sustcsonglin / mamba-triton
  ☆51Updated last year
• srush / mamba-scans
  Blog post
  ☆17Updated last year
• lucidrains / gateloop-transformer
  Implementation of GateLoop Transformer in Pytorch and Jax
  ☆91Updated last year
• srush / triton-autodiff
  Experiment of using Tangent to autodiff triton
  ☆81Updated last year
• BlinkDL / LinearAttentionArena
  Here we will test various linear attention designs.
  ☆62Updated last year
• google-deepmind / spectral_ssm
  ☆35Updated last year
• LIONS-EPFL / scion
  ☆52Updated 3 weeks ago
• proger / hippogriff
  Griffin MQA + Hawk Linear RNN Hybrid
  ☆88Updated last year
• lixilinx / psgd_torch
  Pytorch implementation of preconditioned stochastic gradient descent (Kron and affine preconditioner, low-rank approximation precondition…
  ☆188Updated 2 weeks ago
• lucidrains / taylor-series-linear-attention
  Explorations into the recently proposed Taylor Series Linear Attention
  ☆100Updated last year
• thinking-machines-lab / manifolds
  Supporting code for the blog post on modular manifolds.
  ☆111Updated 3 months ago
• lindermanlab / elk
  Scalable and Stable Parallelization of Nonlinear RNNS
  ☆28Updated 2 months ago
• vvvm23 / mamba-jax
  Unofficial but Efficient Implementation of "Mamba: Linear-Time Sequence Modeling with Selective State Spaces" in JAX
  ☆92Updated last year
• amirzandieh / HyperAttention
  Triton Implementation of HyperAttention Algorithm
  ☆48Updated 2 years ago
• lucidrains / adam-atan2-pytorch
  Implementation of the proposed Adam-atan2 from Google Deepmind in Pytorch
  ☆134Updated 2 months ago
• OpenNLPLab / HGRN2
  HGRN2: Gated Linear RNNs with State Expansion
  ☆56Updated last year
• radarFudan / Curse-of-memory
  Curse-of-memory phenomenon of RNNs in sequence modelling
  ☆19Updated 8 months ago