Alternatives and similar repositories for SGConv:

Users that are interested in SGConv are comparing it to the libraries listed below

• ag1988 / dss
  Sequence Modeling with Structured State Spaces
  ☆63Updated 2 years ago
• google-research / diffstride
  TF/Keras code for DiffStride, a pooling layer with learnable strides.
  ☆125Updated 3 years ago
• lucidrains / gated-state-spaces-pytorch
  Implementation of Gated State Spaces, from the paper "Long Range Language Modeling via Gated State Spaces", in Pytorch
  ☆99Updated 2 years ago
• thjashin / multires-conv
  Sequence Modeling with Multiresolution Convolutional Memory (ICML 2023)
  ☆122Updated last year
• lucidrains / Mega-pytorch
  Implementation of Mega, the Single-head Attention with Multi-headed EMA architecture that currently holds SOTA on Long Range Arena
  ☆204Updated last year
• dwromero / ckconv
  Code repository of the paper "CKConv: Continuous Kernel Convolution For Sequential Data" published at ICLR 2022. https://arxiv.org/abs/21…
  ☆119Updated 2 years ago
• michaelsdr / sinkformers
  Transformers with doubly stochastic attention
  ☆45Updated 2 years ago
• guillaumeBellec / multitask
  ☆22Updated 5 months ago
• facebookresearch / mega
  Sequence modeling with Mega.
  ☆295Updated 2 years ago
• sustcsonglin / flash-linear-rnn
  Implementations of various linear RNN layers using pytorch and triton
  ☆50Updated last year
• HazyResearch / hippo-code
  ☆175Updated 10 months ago
• OATML / RHO-Loss
  ☆201Updated 2 years ago
• lucidrains / flash-cosine-sim-attention
  Implementation of fused cosine similarity attention in the same style as Flash Attention
  ☆212Updated 2 years ago
• michaelsdr / momentumnet
  Drop-in replacement for any ResNet with a significantly reduced memory footprint and better representation capabilities
  ☆209Updated 11 months ago
• alex-matton / causal-transformer-decoder
  ☆75Updated 4 years ago
• lucidrains / perceiver-ar-pytorch
  Implementation of Perceiver AR, Deepmind's new long-context attention network based on Perceiver architecture, in Pytorch
  ☆86Updated last year
• lucidrains / discrete-key-value-bottleneck-pytorch
  Implementation of Discrete Key / Value Bottleneck, in Pytorch
  ☆87Updated last year
• minyoungg / vqtorch
  ☆127Updated last year
• NVIDIA / transformer-ls
  Official PyTorch Implementation of Long-Short Transformer (NeurIPS 2021).
  ☆225Updated 2 years ago
• aliutkus / spe
  Relative Positional Encoding for Transformers with Linear Complexity
  ☆62Updated 3 years ago
• lucidrains / gateloop-transformer
  Implementation of GateLoop Transformer in Pytorch and Jax
  ☆87Updated 9 months ago
• tk-rusch / LEM
  Official code for Long Expressive Memory (ICLR 2022, Spotlight)
  ☆69Updated 3 years ago
• ischlag / fast-weight-transformers
  Official code repository of the paper Linear Transformers Are Secretly Fast Weight Programmers.
  ☆103Updated 3 years ago
• lucidrains / gradnorm-pytorch
  A practical implementation of GradNorm, Gradient Normalization for Adaptive Loss Balancing, in Pytorch
  ☆88Updated last year
• lucidrains / h-transformer-1d
  Implementation of H-Transformer-1D, Hierarchical Attention for Sequence Learning
  ☆160Updated last year
• facebookresearch / FFCV-SSL
  FFCV-SSL Fast Forward Computer Vision for Self-Supervised Learning.
  ☆207Updated last year
• rjbruin / flexconv
  Code repository for the ICLR 2022 paper "FlexConv: Continuous Kernel Convolutions With Differentiable Kernel Sizes" https://openreview.ne…
  ☆115Updated 2 years ago
• shyamsn97 / hyper-nn
  Easy Hypernetworks in Pytorch and Jax
  ☆99Updated 2 years ago
• erksch / fnet-pytorch
  Unofficial PyTorch implementation of Google's FNet: Mixing Tokens with Fourier Transforms. With checkpoints.
  ☆73Updated 2 years ago
• cpcp1998 / PermuteFormer
  Code for the paper PermuteFormer
  ☆42Updated 3 years ago