Alternatives and similar repositories for complex-valued-transformer

Users that are interested in complex-valued-transformer are comparing it to the libraries listed below

• loeweX / ComplexAutoEncoder
  Code for the paper: Complex-Valued Autoencoders for Object Discovery
  ☆57Updated 2 years ago
• Hprairie / Bi-Mamba2
  A Triton Kernel for incorporating Bi-Directionality in Mamba2
  ☆76Updated last year
• jacobfa / fft
  ☆129Updated 5 months ago
• TariqAHassan / S4Torch
  PyTorch implementation of Structured State Space for Sequence Modeling (S4), based on Annotated S4.
  ☆87Updated last year
• lucidrains / agent-attention-pytorch
  Implementation of Agent Attention in Pytorch
  ☆93Updated last year
• lucidrains / gateloop-transformer
  Implementation of GateLoop Transformer in Pytorch and Jax
  ☆91Updated last year
• thjashin / multires-conv
  Sequence Modeling with Multiresolution Convolutional Memory (ICML 2023)
  ☆127Updated 2 years ago
• lucidrains / adam-atan2-pytorch
  Implementation of the proposed Adam-atan2 from Google Deepmind in Pytorch
  ☆134Updated 3 months ago
• soumickmj / pytorch-complex
  ☆56Updated last month
• lucidrains / gradnorm-pytorch
  A practical implementation of GradNorm, Gradient Normalization for Adaptive Loss Balancing, in Pytorch
  ☆125Updated 4 months ago
• i404788 / s5-pytorch
  Pytorch implementation of Simplified Structured State-Spaces for Sequence Modeling (S5)
  ☆82Updated last year
• lucidrains / hl-gauss-pytorch
  The Gaussian Histogram Loss (HL-Gauss) proposed by Imani et al. with a few convenient wrappers for regression, in Pytorch
  ☆71Updated 2 months ago
• josiahwsmith10 / complextorch
  ☆39Updated 9 months ago
• lucidrains / taylor-series-linear-attention
  Explorations into the recently proposed Taylor Series Linear Attention
  ☆100Updated last year
• lucidrains / hyper-connections
  Attempt to make multiple residual streams from Bytedance's Hyper-Connections paper accessible to the public
  ☆139Updated last week
• ruke1ire / RTF
  A State-Space Model with Rational Transfer Function Representation.
  ☆83Updated last year
• lucidrains / minGRU-pytorch
  Implementation of the proposed minGRU in Pytorch
  ☆318Updated last month
• HazyResearch / hippo-code
  ☆192Updated last year
• goombalab / hydra
  Official implementation of "Hydra: Bidirectional State Space Models Through Generalized Matrix Mixers"
  ☆170Updated 11 months ago
• apple / ml-pararnn
  ☆159Updated 2 months ago
• kyegomez / MambaTransformer
  Integrating Mamba/SSMs with Transformer for Enhanced Long Context and High-Quality Sequence Modeling
  ☆213Updated last week
• muqiaoy / dl_signal
  Deep Learning Model for Signal Data
  ☆93Updated 6 years ago
• ag1988 / dss
  Sequence Modeling with Structured State Spaces
  ☆67Updated 3 years ago
• fkodom / soft-mixture-of-experts
  PyTorch implementation of Soft MoE by Google Brain in "From Sparse to Soft Mixtures of Experts" (https://arxiv.org/pdf/2308.00951.pdf)
  ☆81Updated 2 years ago
• ivannz / cplxmodule
  Complex-valued neural networks for pytorch and Variational Dropout for real and complex layers.
  ☆150Updated 3 years ago
• OpenNLPLab / HGRN2
  HGRN2: Gated Linear RNNs with State Expansion
  ☆56Updated last year
• lucidrains / quartic-transformer
  Exploring an idea where one forgets about efficiency and carries out attention across each edge of the nodes (tokens)
  ☆55Updated 9 months ago
• hunar4321 / RLS-neural-net
  Recursive Leasting Squares (RLS) with Neural Network for fast learning
  ☆58Updated 2 years ago
• sustcsonglin / flash-linear-rnn
  Implementations of various linear RNN layers using pytorch and triton
  ☆54Updated 2 years ago
• guillaumeBellec / multitask
  ☆24Updated last year