Alternatives and similar repositories for Transformer-Encoder

Users that are interested in Transformer-Encoder are comparing it to the libraries listed below

• evelinehong / Transformer_Relative_Position_PyTorch
  Implement the paper "Self-Attention with Relative Position Representations"
  ☆135Updated 4 years ago
• fangleai / TransformerCVAE
  Transformer-based Conditional Variational Autoencoder for Controllable Story Generation
  ☆155Updated 3 years ago
• arxyzan / data2vec-pytorch
  PyTorch implementation of "data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Language" from Meta AI
  ☆180Updated 2 years ago
• sooftware / attentions
  PyTorch implementation of some attentions for Deep Learning Researchers.
  ☆534Updated 3 years ago
• huanghonggit / Mask-Language-Model
  pytorch； mask language model ； bert
  ☆72Updated 5 years ago
• CyberZHG / torch-multi-head-attention
  Multi-head attention in PyTorch
  ☆153Updated 6 years ago
• akashe / Multimodal-action-recognition
  Code on selecting an action based on multimodal inputs. Here in this case inputs are voice and text.
  ☆73Updated 4 years ago
• RElbers / info-nce-pytorch
  PyTorch implementation of the InfoNCE loss for self-supervised learning.
  ☆565Updated last year
• lucidrains / bidirectional-cross-attention
  A simple cross attention that updates both the source and target in one step
  ☆172Updated last year
• lucidrains / h-transformer-1d
  Implementation of H-Transformer-1D, Hierarchical Attention for Sequence Learning
  ☆161Updated last year
• Fraser-Greenlee / transformer-vae
  A library for making Transformer Variational Autoencoders. (Extends the Huggingface/transformers library.)
  ☆141Updated 4 years ago
• GuillaumeErhard / Supervised_contrastive_loss_pytorch
  Independent implementation of Supervised Contrastive Loss. Straight to the point and beyond
  ☆81Updated 4 years ago
• yaohungt / Multimodal-Transformer
  [ACL'19] [PyTorch] Multimodal Transformer
  ☆894Updated 2 years ago
• wangz10 / contrastive_loss
  Experiments with supervised contrastive learning methods with different loss functions
  ☆220Updated 2 years ago
• wuch15 / Fastformer
  A pytorch &keras implementation and demo of Fastformer.
  ☆189Updated 2 years ago
• WasifurRahman / BERT_multimodal_transformer
  ☆205Updated 3 years ago
• alex-matton / causal-transformer-decoder
  ☆73Updated 4 years ago
• iffsid / mmvae
  Multimodal Mixture-of-Experts VAE
  ☆212Updated 2 years ago
• salesforce / hierarchicalContrastiveLearning
  ☆160Updated last month
• mathiaszinnen / focal_loss_torch
  Simple pytorch implementation of focal loss
  ☆86Updated 2 years ago
• pliang279 / factorized
  [ICLR 2019] Learning Factorized Multimodal Representations
  ☆67Updated 4 years ago
• jefflai108 / Contrastive-Predictive-Coding-PyTorch
  Contrastive Predictive Coding for Automatic Speaker Verification
  ☆495Updated 5 years ago
• rishikksh20 / FNet-pytorch
  Unofficial implementation of Google's FNet: Mixing Tokens with Fourier Transforms
  ☆259Updated 4 years ago
• seongminp / transformers-into-vaes
  Code for "Finetuning Pretrained Transformers into Variational Autoencoders"
  ☆39Updated 3 years ago
• jedyang97 / MTAG
  Code for NAACL 2021 paper: MTAG: Modal-Temporal Attention Graph for Unaligned Human Multimodal Language Sequences
  ☆43Updated 2 years ago
• janfreyberg / pytorch-revgrad
  A minimal pytorch package implementing a gradient reversal layer.
  ☆158Updated 8 months ago
• jarobyte91 / pytorch_beam_search
  A lightweight implementation of Beam Search for sequence models in PyTorch.
  ☆55Updated last year
• tatp22 / linformer-pytorch
  My take on a practical implementation of Linformer for Pytorch.
  ☆416Updated 2 years ago
• sooftware / pytorch-lr-scheduler
  PyTorch implementation of some learning rate schedulers for deep learning researcher.
  ☆90Updated 2 years ago
• rungjoo / CoMPM
  Context Modeling with Speaker's Pre-trained Memory Tracking for Emotion Recognition in Conversation (NAACL 2022)
  ☆63Updated 2 years ago