Alternatives and similar repositories for Transformer-Encoder

Users that are interested in Transformer-Encoder are comparing it to the libraries listed below

• evelinehong / Transformer_Relative_Position_PyTorch
  Implement the paper "Self-Attention with Relative Position Representations"
  ☆130Updated 4 years ago
• Fraser-Greenlee / transformer-vae
  A library for making Transformer Variational Autoencoders. (Extends the Huggingface/transformers library.)
  ☆140Updated 3 years ago
• smartcameras / SelfCrossAttn
  PyTorch implementation of the models described in the IEEE ICASSP 2022 paper "Is cross-attention preferable to self-attention for multi-m…
  ☆59Updated 2 months ago
• huanghonggit / Mask-Language-Model
  pytorch； mask language model ； bert
  ☆72Updated 5 years ago
• arxyzan / data2vec-pytorch
  PyTorch implementation of "data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Language" from Meta AI
  ☆177Updated 2 years ago
• fangleai / TransformerCVAE
  Transformer-based Conditional Variational Autoencoder for Controllable Story Generation
  ☆155Updated 2 years ago
• akashe / Multimodal-action-recognition
  Code on selecting an action based on multimodal inputs. Here in this case inputs are voice and text.
  ☆73Updated 3 years ago
• WasifurRahman / BERT_multimodal_transformer
  ☆201Updated 3 years ago
• lucidrains / bidirectional-cross-attention
  A simple cross attention that updates both the source and target in one step
  ☆171Updated last year
• salesforce / hierarchicalContrastiveLearning
  ☆157Updated 3 years ago
• samiraabnar / attention_flow
  ☆241Updated 3 years ago
• pliang279 / factorized
  [ICLR 2019] Learning Factorized Multimodal Representations
  ☆67Updated 4 years ago
• monologg / NER-Multimodal-pytorch
  Pytorch Implementation of "Adaptive Co-attention Network for Named Entity Recognition in Tweets" (AAAI 2018)
  ☆56Updated last year
• RElbers / info-nce-pytorch
  PyTorch implementation of the InfoNCE loss for self-supervised learning.
  ☆557Updated last year
• CyberZHG / torch-multi-head-attention
  Multi-head attention in PyTorch
  ☆152Updated 6 years ago
• hainow / MCTN
  ☆48Updated 6 years ago
• alex-matton / causal-transformer-decoder
  ☆72Updated 4 years ago
• seongminp / transformers-into-vaes
  Code for "Finetuning Pretrained Transformers into Variational Autoencoders"
  ☆39Updated 3 years ago
• jbdel / modulated_fusion_transformer
  Modulated Fusion using Transformer for Linguistic-Acoustic Emotion Recognition
  ☆30Updated 4 years ago
• miguelsvasco / gmc
  Official Implementation of "Geometric Multimodal Contrastive Representation Learning" (https://arxiv.org/abs/2202.03390)
  ☆28Updated 5 months ago
• caskcsg / SPCL
  code for "Supervised Prototypical Contrastive Learning for Emotion Recognition in Conversation, EMNLP 22"
  ☆76Updated 2 years ago
• HLTCHKUST / VG-GPLMs
  The code repository for EMNLP 2021 paper "Vision Guided Generative Pre-trained Language Models for Multimodal Abstractive Summarization".
  ☆55Updated 3 years ago
• sunlightsgy / MEmoR
  Code and dataset of "MEmoR: A Dataset for Multimodal Emotion Reasoning in Videos" in MM'20.
  ☆54Updated last year
• 312shan / Pytorch-seq2seq-Beam-Search
  PyTorch implementation for Seq2Seq model with attention and Greedy Search / Beam Search for neural machine translation
  ☆58Updated 4 years ago
• artelab / Image-and-Text-fusion-for-UPMC-Food-101-using-BERT-and-CNNs
  ☆59Updated 3 years ago
• andrewpeng02 / transformer-translation
  Using Pytorch's nn.Transformer module to create an english to french neural machine translation model.
  ☆78Updated 4 years ago
• rungjoo / CoMPM
  Context Modeling with Speaker's Pre-trained Memory Tracking for Emotion Recognition in Conversation (NAACL 2022)
  ☆63Updated 2 years ago
• dashstander / block-recurrent-transformer
  Pytorch implementation of "Block Recurrent Transformers" (Hutchins & Schlag et al., 2022)
  ☆84Updated 3 years ago
• wangz10 / contrastive_loss
  Experiments with supervised contrastive learning methods with different loss functions
  ☆220Updated 2 years ago
• facebookresearch / mmbt
  Supervised Multimodal Bitransformers for Classifying Images and Text
  ☆254Updated 3 years ago