Alternatives and similar repositories for Transformer-Encoder:

Users that are interested in Transformer-Encoder are comparing it to the libraries listed below

• arxyzan / data2vec-pytorch
  PyTorch implementation of "data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Language" from Meta AI
  ☆176Updated last year
• huanghonggit / Mask-Language-Model
  pytorch； mask language model ； bert
  ☆72Updated 5 years ago
• fangleai / TransformerCVAE
  Transformer-based Conditional Variational Autoencoder for Controllable Story Generation
  ☆151Updated 2 years ago
• akashe / Multimodal-action-recognition
  Code on selecting an action based on multimodal inputs. Here in this case inputs are voice and text.
  ☆69Updated 3 years ago
• GuillaumeErhard / Supervised_contrastive_loss_pytorch
  Independent implementation of Supervised Contrastive Loss. Straight to the point and beyond
  ☆79Updated 4 years ago
• evelinehong / Transformer_Relative_Position_PyTorch
  Implement the paper "Self-Attention with Relative Position Representations"
  ☆125Updated 4 years ago
• mttk / rnn-classifier
  Minimal RNN classifier with self-attention in Pytorch
  ☆150Updated 3 years ago
• sl-93 / SUPERVISED-CONTRASTIVE-LEARNING-FOR-PRE-TRAINED-LANGUAGE-MODEL-FINE-TUNING
  in this project, I've implemented the Facebook paper about fine tuning RoBERTa with contrastive loss.
  ☆58Updated 2 years ago
• lucidrains / h-transformer-1d
  Implementation of H-Transformer-1D, Hierarchical Attention for Sequence Learning
  ☆160Updated last year
• CyberZHG / torch-multi-head-attention
  Multi-head attention in PyTorch
  ☆150Updated 5 years ago
• jbdel / modulated_fusion_transformer
  Modulated Fusion using Transformer for Linguistic-Acoustic Emotion Recognition
  ☆30Updated 4 years ago
• seongminp / transformers-into-vaes
  Code for "Finetuning Pretrained Transformers into Variational Autoencoders"
  ☆37Updated 2 years ago
• salesforce / hierarchicalContrastiveLearning
  ☆154Updated 2 years ago
• lucidrains / bidirectional-cross-attention
  A simple cross attention that updates both the source and target in one step
  ☆162Updated 9 months ago
• WasifurRahman / BERT_multimodal_transformer
  ☆199Updated 3 years ago
• miguelsvasco / gmc
  Official Implementation of "Geometric Multimodal Contrastive Representation Learning" (https://arxiv.org/abs/2202.03390)
  ☆28Updated last month
• smartcameras / SelfCrossAttn
  PyTorch implementation of the models described in the IEEE ICASSP 2022 paper "Is cross-attention preferable to self-attention for multi-m…
  ☆58Updated 2 years ago
• ivyha010 / AttendAffectNet
  ☆17Updated 4 years ago
• HLTCHKUST / VG-GPLMs
  The code repository for EMNLP 2021 paper "Vision Guided Generative Pre-trained Language Models for Multimodal Abstractive Summarization".
  ☆55Updated 3 years ago
• pliang279 / factorized
  [ICLR 2019] Learning Factorized Multimodal Representations
  ☆67Updated 4 years ago
• Spijkervet / contrastive-predictive-coding
  PyTorch implementation of Representation Learning with Contrastive Predictive Coding by Van den Oord et al. (2018)
  ☆83Updated 3 years ago
• wangz10 / contrastive_loss
  Experiments with supervised contrastive learning methods with different loss functions
  ☆218Updated 2 years ago
• jarobyte91 / pytorch_beam_search
  A lightweight implementation of Beam Search for sequence models in PyTorch.
  ☆53Updated 7 months ago
• alex-matton / causal-transformer-decoder
  ☆72Updated 3 years ago
• hainow / MCTN
  ☆48Updated 6 years ago
• sooftware / attentions
  PyTorch implementation of some attentions for Deep Learning Researchers.
  ☆523Updated 2 years ago
• tm4roon / pytorch-seq2seq
  An Implementation of Encoder-Decoder model with global attention mechanism.
  ☆32Updated 5 years ago
• artelab / Image-and-Text-fusion-for-UPMC-Food-101-using-BERT-and-CNNs
  ☆58Updated 3 years ago
• sodawater / T-CVAE
  Transformer-Based Conditioned Variational Autoencoder for Story Completion
  ☆94Updated 4 years ago
• monologg / NER-Multimodal-pytorch
  Pytorch Implementation of "Adaptive Co-attention Network for Named Entity Recognition in Tweets" (AAAI 2018)
  ☆57Updated last year