Alternatives and similar repositories for SGConv

Users that are interested in SGConv are comparing it to the libraries listed below

• lucidrains / Mega-pytorch
  Implementation of Mega, the Single-head Attention with Multi-headed EMA architecture that currently holds SOTA on Long Range Arena
  ☆206Updated 2 years ago
• ag1988 / dss
  Sequence Modeling with Structured State Spaces
  ☆67Updated 3 years ago
• lucidrains / gated-state-spaces-pytorch
  Implementation of Gated State Spaces, from the paper "Long Range Language Modeling via Gated State Spaces", in Pytorch
  ☆101Updated 2 years ago
• google-research / diffstride
  TF/Keras code for DiffStride, a pooling layer with learnable strides.
  ☆124Updated 3 years ago
• thjashin / multires-conv
  Sequence Modeling with Multiresolution Convolutional Memory (ICML 2023)
  ☆127Updated 2 years ago
• facebookresearch / mega
  Sequence modeling with Mega.
  ☆302Updated 2 years ago
• dwromero / ckconv
  Code repository of the paper "CKConv: Continuous Kernel Convolution For Sequential Data" published at ICLR 2022. https://arxiv.org/abs/21…
  ☆124Updated 3 years ago
• HazyResearch / hippo-code
  ☆191Updated last year
• erksch / fnet-pytorch
  Unofficial PyTorch implementation of Google's FNet: Mixing Tokens with Fourier Transforms. With checkpoints.
  ☆77Updated 3 years ago
• lucidrains / flash-cosine-sim-attention
  Implementation of fused cosine similarity attention in the same style as Flash Attention
  ☆219Updated 2 years ago
• lucidrains / gateloop-transformer
  Implementation of GateLoop Transformer in Pytorch and Jax
  ☆91Updated last year
• pseeth / autoclip
  Adaptive Gradient Clipping
  ☆153Updated 3 years ago
• sustcsonglin / flash-linear-rnn
  Implementations of various linear RNN layers using pytorch and triton
  ☆54Updated 2 years ago
• lucidrains / nystrom-attention
  Implementation of Nyström Self-attention, from the paper Nyströmformer
  ☆144Updated 9 months ago
• lucidrains / ponder-transformer
  Implementation of a Transformer that Ponders, using the scheme from the PonderNet paper
  ☆81Updated 4 years ago
• lucidrains / linformer
  Implementation of Linformer for Pytorch
  ☆303Updated last year
• ischlag / fast-weight-transformers
  Official code repository of the paper Linear Transformers Are Secretly Fast Weight Programmers.
  ☆111Updated 4 years ago
• lucidrains / Adan-pytorch
  Implementation of the Adan (ADAptive Nesterov momentum algorithm) Optimizer in Pytorch
  ☆252Updated 3 years ago
• NVIDIA / transformer-ls
  Official PyTorch Implementation of Long-Short Transformer (NeurIPS 2021).
  ☆228Updated 3 years ago
• guillaumeBellec / multitask
  ☆24Updated last year
• OATML / RHO-Loss
  ☆210Updated 3 years ago
• peerdavid / layerwise-batch-entropy
  Layerwise Batch Entropy Regularization
  ☆24Updated 3 years ago
• lucidrains / block-recurrent-transformer-pytorch
  Implementation of Block Recurrent Transformer - Pytorch
  ☆223Updated last year
• alex-matton / causal-transformer-decoder
  ☆73Updated 4 years ago
• aliutkus / spe
  Relative Positional Encoding for Transformers with Linear Complexity
  ☆65Updated 3 years ago
• lucidrains / discrete-key-value-bottleneck-pytorch
  Implementation of Discrete Key / Value Bottleneck, in Pytorch
  ☆88Updated 2 years ago
• jiaweizzhao / ZerO-initialization
  ☆75Updated 3 years ago
• tk-rusch / LEM
  Official code for Long Expressive Memory (ICLR 2022, Spotlight)
  ☆71Updated 3 years ago
• lucidrains / compressive-transformer-pytorch
  Pytorch implementation of Compressive Transformers, from Deepmind
  ☆163Updated 4 years ago
• gcambara / cape
  Continuous Augmented Positional Embeddings (CAPE) implementation for PyTorch
  ☆42Updated 3 years ago