JohnGiorgi / compact-multi-head-self-attention-pytorch

Related projects: ⓘ

• lancopku / AdaNorm
  Code for "Understanding and Improving Layer Normalization"
  ☆44Updated 4 years ago
• martinmamql / relative_predictive_coding
  Project page for paper Self-supervised Representation Learning with Relative Predictive Coding
  ☆17Updated 3 years ago
• lioutasb / TaLKConvolutions
  Official PyTorch implementation of Time-aware Large Kernel (TaLK) Convolutions (ICML 2020)
  ☆29Updated 3 years ago
• jackyyy0228 / Order-free-Learning-Alleviating-Exposure-Bias-in-Multi-label-Classification
  ☆20Updated 4 years ago
• fawazsammani / mogrifier-lstm-pytorch
  Implementation of Mogrifier LSTM in PyTorch
  ☆35Updated 4 years ago
• rpryzant / proxy-a-distance
  Proxy A-Distance algorithm for measuring domain disparity in parallel corpora
  ☆45Updated 2 years ago
• gitabcworld / skiprnn_pytorch
  A pytorch implementation of the paper: "Skip RNN: Learning to Skip State Updates in Recurrent Neural Networks"
  ☆81Updated 5 years ago
• yaohungt / TransformerDissection
  [EMNLP'19] Summary for Transformer Understanding
  ☆51Updated 4 years ago
• davidsvy / cosformer-pytorch
  Unofficial PyTorch implementation of the paper "cosFormer: Rethinking Softmax In Attention".
  ☆43Updated 2 years ago
• demelin / Noise-Contrastive-Estimation-NCE-for-pyTorch
  Re-implementation of the Noise Contrastive Estimation algorithm for pyTorch, following "Noise-contrastive estimation: A new estimation pr…
  ☆45Updated 5 years ago
• 10-zin / Synthesizer
  A PyTorch implementation of the paper - "Synthesizer: Rethinking Self-Attention in Transformer Models"
  ☆70Updated last year
• DeadAt0m / adafactor-pytorch
  A pytorch realization of adafactor (https://arxiv.org/pdf/1804.04235.pdf )
  ☆24Updated 5 years ago
• ItzikMalkiel / MTAdam
  MTAdam: Automatic Balancing of Multiple Training Loss Terms
  ☆34Updated 3 years ago
• rycolab / entropyRegularization
  Code for Generalized Entropy Regularization paper
  ☆13Updated 4 years ago
• HA-Transformer / MAT
  The implementation of multi-branch attentive Transformer (MAT).
  ☆33Updated 4 years ago
• lucidrains / axial-positional-embedding
  Axial Positional Embedding for Pytorch
  ☆61Updated 3 years ago
• jaywalnut310 / Vector-Quantized-Autoencoders
  Tensorflow Implementation of "Theory and Experiments on Vector Quantized Autoencoders"
  ☆14Updated 5 years ago
• mlpc-ucsd / BERT_Convolutions
  (ACL-IJCNLP 2021) Convolutions and Self-Attention: Re-interpreting Relative Positions in Pre-trained Language Models.
  ☆21Updated 2 years ago
• rcalland / deep-INFOMAX
  Chainer implementation of deep-INFOMAX
  ☆34Updated 6 years ago
• ayaabdelsalam91 / Input-Cell-Attention
  ☆12Updated 4 years ago
• calclavia / Performer-Pytorch
  Pytorch implementation of Performer from the paper "Rethinking Attention with Performers".
  ☆23Updated 3 years ago
• jaketae / fnet
  PyTorch implementation of FNet: Mixing Tokens with Fourier transforms
  ☆25Updated 3 years ago
• nolfwin / symloss-ber-auc
  Code for the paper: On Symmetric Losses for Learning from Corrupted Labels
  ☆18Updated 5 years ago
• juntang-zhuang / fairseq-adabelief
  ☆9Updated 3 years ago
• Manuscrit / Area-Under-the-Margin-Ranking
  Implementation of the paper Identifying Mislabeled Data using the Area Under the Margin Ranking: https://arxiv.org/pdf/2001.10528v2.pdf
  ☆21Updated 4 years ago
• shaabhishek / gumbel-softmax-pytorch
  categorical variational autoencoder using the Gumbel-Softmax estimator
  ☆25Updated 5 years ago
• jiamings / ml-cpc
  ☆36Updated 3 years ago
• QData / LaMP
  ECML 2019: Graph Neural Networks for Multi-Label Classification
  ☆89Updated last month
• MLforHealth / S2SD
  (ICML 2021) Implementation for S2SD - Simultaneous Similarity-based Self-Distillation for Deep Metric Learning. Paper Link: https://arxiv…
  ☆41Updated 4 years ago
• hrayrhar / limit-label-memorization
  Improving generalization by controlling label-noise information in neural network weights.
  ☆39Updated 3 years ago