ag1988 / dss

Related projects ⓘ

Alternatives and complementary repositories for dss

• lucidrains / gated-state-spaces-pytorch
  Implementation of Gated State Spaces, from the paper "Long Range Language Modeling via Gated State Spaces", in Pytorch
  ☆95Updated last year
• ctlllll / SGConv
  ☆164Updated last year
• thjashin / multires-conv
  Sequence Modeling with Multiresolution Convolutional Memory (ICML 2023)
  ☆120Updated last year
• michaelsdr / sinkformers
  Transformers with doubly stochastic attention
  ☆40Updated 2 years ago
• lucidrains / ponder-transformer
  Implementation of a Transformer that Ponders, using the scheme from the PonderNet paper
  ☆79Updated 3 years ago
• aliutkus / spe
  Relative Positional Encoding for Transformers with Linear Complexity
  ☆61Updated 2 years ago
• shikaiqiu / compute-better-spent
  ☆46Updated last month
• sustcsonglin / flash-linear-rnn
  Implementations of various linear RNN layers using pytorch and triton
  ☆46Updated last year
• ischlag / fast-weight-transformers
  Official code repository of the paper Linear Transformers Are Secretly Fast Weight Programmers.
  ☆100Updated 3 years ago
• lucidrains / Mega-pytorch
  Implementation of Mega, the Single-head Attention with Multi-headed EMA architecture that currently holds SOTA on Long Range Arena
  ☆203Updated last year
• HazyResearch / hippo-code
  ☆167Updated 5 months ago
• tk-rusch / LEM
  Official code for Long Expressive Memory (ICLR 2022, Spotlight)
  ☆69Updated 2 years ago
• OpenNLPLab / HGRN
  [NeurIPS 2023 spotlight] Official implementation of HGRN in our NeurIPS 2023 paper - Hierarchically Gated Recurrent Neural Network for Se…
  ☆61Updated 6 months ago
• RobertCsordas / transformer_generalization
  The official repository for our paper "The Devil is in the Detail: Simple Tricks Improve Systematic Generalization of Transformers". We s…
  ☆66Updated last year
• revsic / jax-variational-diffwave
  Jax/Flax implementation of Variational-DiffWave.
  ☆40Updated 2 years ago
• lucidrains / kalman-filtering-attention
  Implementation of the Kalman Filtering Attention proposed in "Kalman Filtering Attention for User Behavior Modeling in CTR Prediction"
  ☆57Updated last year
• sustcsonglin / gated_linear_attention_layer
  ☆31Updated 10 months ago
• alex-matton / causal-transformer-decoder
  ☆72Updated 3 years ago
• dwromero / ckconv
  Code repository of the paper "CKConv: Continuous Kernel Convolution For Sequential Data" published at ICLR 2022. https://arxiv.org/abs/21…
  ☆117Updated last year
• lucidrains / perceiver-ar-pytorch
  Implementation of Perceiver AR, Deepmind's new long-context attention network based on Perceiver architecture, in Pytorch
  ☆86Updated last year
• lucidrains / product-key-memory
  Standalone Product Key Memory module in Pytorch - for augmenting Transformer models
  ☆72Updated 3 months ago
• lucidrains / h-transformer-1d
  Implementation of H-Transformer-1D, Hierarchical Attention for Sequence Learning
  ☆155Updated 9 months ago
• vvvm23 / mamba-jax
  Unofficial but Efficient Implementation of "Mamba: Linear-Time Sequence Modeling with Selective State Spaces" in JAX
  ☆79Updated 9 months ago
• cpcp1998 / PermuteFormer
  Code for the paper PermuteFormer
  ☆42Updated 3 years ago
• ethancaballero / broken_neural_scaling_laws
  Code Release for "Broken Neural Scaling Laws" (BNSL) paper
  ☆57Updated last year
• facebookresearch / mega
  Sequence modeling with Mega.
  ☆298Updated last year
• expz / annotated-hyena
  An annotated implementation of the Hyena Hierarchy paper
  ☆31Updated last year
• tml-epfl / why-weight-decay
  Why Do We Need Weight Decay in Modern Deep Learning? [NeurIPS 2024]
  ☆52Updated last month
• sarthmit / Compositional-Attention
  Code to reproduce the results for Compositional Attention
  ☆60Updated 2 years ago
• GFNOrg / GFlowNet-EM
  Code for GFlowNet-EM, a novel algorithm for fitting latent variable models with compositional latents and an intractable true posterior.
  ☆38Updated 9 months ago