rishikksh20 / rectified-linear-attention

Related projects ⓘ

Alternatives and complementary repositories for rectified-linear-attention

• Chenglin-Yang / LESA
  Locally Enhanced Self-Attention: Rethinking Self-Attention as Local and Context Terms
  ☆20Updated 2 years ago
• DequanWang / weightnet.pytorch
  WeightNet: Revisiting the Design Space of Weight Networks
  ☆18Updated 3 years ago
• jaketae / g-mlp
  PyTorch implementation of Pay Attention to MLPs
  ☆39Updated 3 years ago
• davidsvy / cosformer-pytorch
  Unofficial PyTorch implementation of the paper "cosFormer: Rethinking Softmax In Attention".
  ☆43Updated 3 years ago
• hunto / ReLoss
  Official implementation for paper "Relational Surrogate Loss Learning", ICLR 2022
  ☆37Updated last year
• fawazsammani / mogrifier-lstm-pytorch
  Implementation of Mogrifier LSTM in PyTorch
  ☆35Updated 4 years ago
• Noahs-ARK / RFA
  ☆32Updated 3 years ago
• yuweihao / LV-BERT
  LV-BERT: Exploiting Layer Variety for BERT (Findings of ACL 2021)
  ☆18Updated last year
• yikangshen / MoA
  Mixture of Attention Heads
  ☆39Updated 2 years ago
• elis2496 / maxup_implementation
  ☆12Updated 4 years ago
• layumi / ICME2022SS
  ICME2022 Special Session “Beyond Accuracy: Responsible, Responsive, and Robust Multimedia Retrieval ”
  ☆11Updated 5 months ago
• lucidrains / omninet-pytorch
  Implementation of OmniNet, Omnidirectional Representations from Transformers, in Pytorch
  ☆55Updated 3 years ago
• lucidrains / remixer-pytorch
  Implementation of the Remixer Block from the Remixer paper, in Pytorch
  ☆35Updated 3 years ago
• yhlleo / RG-UNIT
  RG-UNIT, ACM MM 2020.
  ☆11Updated 3 years ago
• btma48 / AutoLA
  Code of our Neurips2020 paper "Auto Learning Attention", coming soon
  ☆21Updated 3 years ago
• lancopku / Explicit-Sparse-Transformer
  code for Explicit Sparse Transformer
  ☆56Updated last year
• d-li14 / mlp-mixer.pytorch
  PyTorch implementation of MLP-Mixer
  ☆36Updated 3 years ago
• mlpc-ucsd / BERT_Convolutions
  (ACL-IJCNLP 2021) Convolutions and Self-Attention: Re-interpreting Relative Positions in Pre-trained Language Models.
  ☆21Updated 2 years ago
• yhlleo / DWC-GAN
  DWC-GAN, ACM MM 2020.
  ☆32Updated 3 years ago
• islamamirul / PermuteNet
  ☆33Updated 2 years ago
• rishikksh20 / CoaT-pytorch
  CoaT: Co-Scale Conv-Attentional Image Transformers
  ☆16Updated 3 years ago
• CupidJay / MoCov3-pytorch
  custom pytorch implementation of MoCo v3
  ☆44Updated 3 years ago
• cheneydon / efficient-bert
  This repository contains the code for the paper in Findings of EMNLP 2021: "EfficientBERT: Progressively Searching Multilayer Perceptron …
  ☆32Updated last year
• sanagno / neurips_2022_statistics
  ☆17Updated 2 years ago
• okojoalg / raft-mlp
  ☆25Updated 2 years ago
• xuanqing94 / FLOATER
  Learning to Encode Position for Transformer with Continuous Dynamical Model
  ☆59Updated 4 years ago
• zeke-xie / stable-weight-decay-regularization
  [NeurIPS 2023] The PyTorch Implementation of Scheduled (Stable) Weight Decay.
  ☆58Updated 9 months ago
• ziplab / HVT
  [ICCV 2021] Official implementation of "Scalable Vision Transformers with Hierarchical Pooling"
  ☆31Updated 2 years ago
• Caoang327 / vis_det
  Code of "Visualizing and Understanding Object Detecor"
  ☆20Updated 3 years ago
• lucidrains / AoA-pytorch
  A Pytorch implementation of Attention on Attention module (both self and guided variants), for Visual Question Answering
  ☆40Updated 4 years ago