Alternatives and similar repositories for complex-valued-transformer

Users that are interested in complex-valued-transformer are comparing it to the libraries listed below

• lucidrains / adam-atan2-pytorch
  Implementation of the proposed Adam-atan2 from Google Deepmind in Pytorch
  ☆115Updated 8 months ago
• i404788 / s5-pytorch
  Pytorch implementation of Simplified Structured State-Spaces for Sequence Modeling (S5)
  ☆77Updated last year
• jacobfa / fft
  ☆125Updated 2 months ago
• thjashin / multires-conv
  Sequence Modeling with Multiresolution Convolutional Memory (ICML 2023)
  ☆125Updated last year
• josiahwsmith10 / complextorch
  ☆32Updated 3 months ago
• lucidrains / gradnorm-pytorch
  A practical implementation of GradNorm, Gradient Normalization for Adaptive Loss Balancing, in Pytorch
  ☆100Updated last year
• lucidrains / gateloop-transformer
  Implementation of GateLoop Transformer in Pytorch and Jax
  ☆89Updated last year
• soumickmj / pytorch-complex
  ☆57Updated last month
• jloveric / high-order-layers-torch
  High order and sparse layers in pytorch. Lagrange Polynomial, Piecewise Lagrange Polynomial, Piecewise Discontinuous Lagrange Polynomial…
  ☆45Updated last year
• ag1988 / dss
  Sequence Modeling with Structured State Spaces
  ☆65Updated 3 years ago
• ruke1ire / RTF
  A State-Space Model with Rational Transfer Function Representation.
  ☆79Updated last year
• lucidrains / agent-attention-pytorch
  Implementation of Agent Attention in Pytorch
  ☆91Updated last year
• sustcsonglin / flash-linear-rnn
  Implementations of various linear RNN layers using pytorch and triton
  ☆53Updated 2 years ago
• lucidrains / taylor-series-linear-attention
  Explorations into the recently proposed Taylor Series Linear Attention
  ☆100Updated 11 months ago
• loeweX / ComplexAutoEncoder
  Code for the paper: Complex-Valued Autoencoders for Object Discovery
  ☆56Updated 2 years ago
• Hprairie / Bi-Mamba2
  A Triton Kernel for incorporating Bi-Directionality in Mamba2
  ☆74Updated 7 months ago
• lucidrains / hl-gauss-pytorch
  The Gaussian Histogram Loss (HL-Gauss) proposed by Imani et al. with a few convenient wrappers for regression, in Pytorch
  ☆65Updated 2 months ago
• TariqAHassan / S4Torch
  PyTorch implementation of Structured State Space for Sequence Modeling (S4), based on Annotated S4.
  ☆83Updated last year
• lucidrains / kalman-filtering-attention
  Implementation of the Kalman Filtering Attention proposed in "Kalman Filtering Attention for User Behavior Modeling in CTR Prediction"
  ☆58Updated last year
• lucidrains / minGRU-pytorch
  Implementation of the proposed minGRU in Pytorch
  ☆300Updated 4 months ago
• lucidrains / hyper-connections
  Attempt to make multiple residual streams from Bytedance's Hyper-Connections paper accessible to the public
  ☆88Updated last month
• hunar4321 / RLS-neural-net
  Recursive Leasting Squares (RLS) with Neural Network for fast learning
  ☆56Updated last year
• ctlllll / SGConv
  ☆163Updated 2 years ago
• goombalab / hydra
  Official implementation of "Hydra: Bidirectional State Space Models Through Generalized Matrix Mixers"
  ☆151Updated 6 months ago
• guillaumeBellec / multitask
  ☆24Updated 9 months ago
• GistNoesis / FusedFourierKAN
  C++ and Cuda ops for fused FourierKAN
  ☆80Updated last year
• fkodom / yet-another-retnet
  A simple but robust PyTorch implementation of RetNet from "Retentive Network: A Successor to Transformer for Large Language Models" (http…
  ☆106Updated last year
• lucidrains / quartic-transformer
  Exploring an idea where one forgets about efficiency and carries out attention across each edge of the nodes (tokens)
  ☆52Updated 4 months ago
• proger / hippogriff
  Griffin MQA + Hawk Linear RNN Hybrid
  ☆88Updated last year
• willGuimont / learnable_fourier_positional_encoding
  Learnable Fourier Features for Multi-Dimensional Spatial Positional Encoding
  ☆55Updated 10 months ago