Alternatives and similar repositories for complex-valued-transformer

Users that are interested in complex-valued-transformer are comparing it to the libraries listed below

• TariqAHassan / S4Torch
  PyTorch implementation of Structured State Space for Sequence Modeling (S4), based on Annotated S4.
  ☆87Updated last year
• jacobfa / fft
  ☆129Updated 4 months ago
• i404788 / s5-pytorch
  Pytorch implementation of Simplified Structured State-Spaces for Sequence Modeling (S5)
  ☆81Updated last year
• sustcsonglin / flash-linear-rnn
  Implementations of various linear RNN layers using pytorch and triton
  ☆54Updated 2 years ago
• loeweX / ComplexAutoEncoder
  Code for the paper: Complex-Valued Autoencoders for Object Discovery
  ☆57Updated 2 years ago
• ruke1ire / RTF
  A State-Space Model with Rational Transfer Function Representation.
  ☆83Updated last year
• soumickmj / pytorch-complex
  ☆56Updated last week
• lucidrains / adam-atan2-pytorch
  Implementation of the proposed Adam-atan2 from Google Deepmind in Pytorch
  ☆134Updated 2 months ago
• lucidrains / gradnorm-pytorch
  A practical implementation of GradNorm, Gradient Normalization for Adaptive Loss Balancing, in Pytorch
  ☆122Updated 4 months ago
• lucidrains / agent-attention-pytorch
  Implementation of Agent Attention in Pytorch
  ☆93Updated last year
• thjashin / multires-conv
  Sequence Modeling with Multiresolution Convolutional Memory (ICML 2023)
  ☆127Updated 2 years ago
• josiahwsmith10 / complextorch
  ☆39Updated 8 months ago
• Hprairie / Bi-Mamba2
  A Triton Kernel for incorporating Bi-Directionality in Mamba2
  ☆75Updated last year
• fkodom / yet-another-retnet
  A simple but robust PyTorch implementation of RetNet from "Retentive Network: A Successor to Transformer for Large Language Models" (http…
  ☆106Updated 2 years ago
• ctlllll / SGConv
  ☆164Updated 2 years ago
• K-H-Ismail / Dilated-Convolution-with-Learnable-Spacings-PyTorch
  [ICLR 2023] "Dilated convolution with learnable spacings" Ismail Khalfaoui Hassani, Thomas Pellegrini and Timothée Masquelier
  ☆73Updated this week
• lucidrains / taylor-series-linear-attention
  Explorations into the recently proposed Taylor Series Linear Attention
  ☆100Updated last year
• ag1988 / dss
  Sequence Modeling with Structured State Spaces
  ☆67Updated 3 years ago
• goombalab / hydra
  Official implementation of "Hydra: Bidirectional State Space Models Through Generalized Matrix Mixers"
  ☆168Updated 10 months ago
• lucidrains / minGRU-pytorch
  Implementation of the proposed minGRU in Pytorch
  ☆315Updated 2 weeks ago
• lucidrains / gateloop-transformer
  Implementation of GateLoop Transformer in Pytorch and Jax
  ☆91Updated last year
• apapiu / mamba_small_bench
  Trying out the Mamba architecture on small examples (cifar-10, shakespeare char level etc.)
  ☆47Updated 2 years ago
• lindermanlab / S5
  ☆312Updated 11 months ago
• apple / ml-pararnn
  ☆156Updated last month
• fkodom / soft-mixture-of-experts
  PyTorch implementation of Soft MoE by Google Brain in "From Sparse to Soft Mixtures of Experts" (https://arxiv.org/pdf/2308.00951.pdf)
  ☆81Updated 2 years ago
• AmeenAli / HiddenMambaAttn
  Official PyTorch Implementation of "The Hidden Attention of Mamba Models"
  ☆232Updated 2 months ago
• kyegomez / MambaTransformer
  Integrating Mamba/SSMs with Transformer for Enhanced Long Context and High-Quality Sequence Modeling
  ☆211Updated 2 months ago
• lessw2020 / FAdam_PyTorch
  an implementation of FAdam (Fisher Adam) in PyTorch
  ☆49Updated 5 months ago
• muqiaoy / dl_signal
  Deep Learning Model for Signal Data
  ☆92Updated 6 years ago
• lucidrains / hyper-connections
  Attempt to make multiple residual streams from Bytedance's Hyper-Connections paper accessible to the public
  ☆94Updated 6 months ago