Alternatives and similar repositories for complex-valued-transformer

Users that are interested in complex-valued-transformer are comparing it to the libraries listed below

• lucidrains / adam-atan2-pytorch
  Implementation of the proposed Adam-atan2 from Google Deepmind in Pytorch
  ☆123Updated 9 months ago
• lucidrains / agent-attention-pytorch
  Implementation of Agent Attention in Pytorch
  ☆91Updated last year
• ruke1ire / RTF
  A State-Space Model with Rational Transfer Function Representation.
  ☆81Updated last year
• soumickmj / pytorch-complex
  ☆57Updated 2 months ago
• TariqAHassan / S4Torch
  PyTorch implementation of Structured State Space for Sequence Modeling (S4), based on Annotated S4.
  ☆86Updated last year
• lucidrains / gradnorm-pytorch
  A practical implementation of GradNorm, Gradient Normalization for Adaptive Loss Balancing, in Pytorch
  ☆107Updated 3 weeks ago
• jacobfa / fft
  ☆128Updated last month
• Hprairie / Bi-Mamba2
  A Triton Kernel for incorporating Bi-Directionality in Mamba2
  ☆75Updated 9 months ago
• lucidrains / taylor-series-linear-attention
  Explorations into the recently proposed Taylor Series Linear Attention
  ☆100Updated last year
• lucidrains / minGRU-pytorch
  Implementation of the proposed minGRU in Pytorch
  ☆302Updated 6 months ago
• sustcsonglin / flash-linear-rnn
  Implementations of various linear RNN layers using pytorch and triton
  ☆53Updated 2 years ago
• thjashin / multires-conv
  Sequence Modeling with Multiresolution Convolutional Memory (ICML 2023)
  ☆127Updated last year
• lucidrains / hl-gauss-pytorch
  The Gaussian Histogram Loss (HL-Gauss) proposed by Imani et al. with a few convenient wrappers for regression, in Pytorch
  ☆65Updated last month
• kyegomez / Griffin
  Implementation of Griffin from the paper: "Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models"
  ☆56Updated last week
• loeweX / ComplexAutoEncoder
  Code for the paper: Complex-Valued Autoencoders for Object Discovery
  ☆56Updated 2 years ago
• i404788 / s5-pytorch
  Pytorch implementation of Simplified Structured State-Spaces for Sequence Modeling (S5)
  ☆78Updated last year
• muqiaoy / dl_signal
  Deep Learning Model for Signal Data
  ☆89Updated 5 years ago
• goombalab / hydra
  Official implementation of "Hydra: Bidirectional State Space Models Through Generalized Matrix Mixers"
  ☆158Updated 7 months ago
• josiahwsmith10 / complextorch
  ☆35Updated 5 months ago
• lucidrains / gateloop-transformer
  Implementation of GateLoop Transformer in Pytorch and Jax
  ☆90Updated last year
• erksch / fnet-pytorch
  Unofficial PyTorch implementation of Google's FNet: Mixing Tokens with Fourier Transforms. With checkpoints.
  ☆76Updated 3 years ago
• kyegomez / MambaTransformer
  Integrating Mamba/SSMs with Transformer for Enhanced Long Context and High-Quality Sequence Modeling
  ☆206Updated last week
• StarostinV / convkan
  Convolutional layer for Kolmogorov-Arnold Network (KAN)
  ☆110Updated 5 months ago
• NVlabs / ConvSSM
  ☆66Updated 10 months ago
• ctlllll / SGConv
  ☆164Updated 2 years ago
• lucidrains / hyper-connections
  Attempt to make multiple residual streams from Bytedance's Hyper-Connections paper accessible to the public
  ☆90Updated 3 months ago
• apapiu / mamba_small_bench
  Trying out the Mamba architecture on small examples (cifar-10, shakespeare char level etc.)
  ☆47Updated last year
• jloveric / high-order-layers-torch
  High order and sparse layers in pytorch. Lagrange Polynomial, Piecewise Lagrange Polynomial, Piecewise Discontinuous Lagrange Polynomial…
  ☆45Updated last year
• ag1988 / dss
  Sequence Modeling with Structured State Spaces
  ☆66Updated 3 years ago
• lessw2020 / FAdam_PyTorch
  an implementation of FAdam (Fisher Adam) in PyTorch
  ☆49Updated 2 months ago