Alternatives and similar repositories for Transformer-Encoder

Users that are interested in Transformer-Encoder are comparing it to the libraries listed below

• evelinehong / Transformer_Relative_Position_PyTorch
  Implement the paper "Self-Attention with Relative Position Representations"
  ☆139Updated 5 years ago
• arxyzan / data2vec-pytorch
  PyTorch implementation of "data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Language" from Meta AI
  ☆184Updated 2 years ago
• fangleai / TransformerCVAE
  Transformer-based Conditional Variational Autoencoder for Controllable Story Generation
  ☆164Updated 3 years ago
• Fraser-Greenlee / transformer-vae
  A library for making Transformer Variational Autoencoders. (Extends the Huggingface/transformers library.)
  ☆146Updated 4 years ago
• RElbers / info-nce-pytorch
  PyTorch implementation of the InfoNCE loss for self-supervised learning.
  ☆606Updated 2 years ago
• lucidrains / bidirectional-cross-attention
  A simple cross attention that updates both the source and target in one step
  ☆195Updated 6 months ago
• huanghonggit / Mask-Language-Model
  pytorch； mask language model ； bert
  ☆73Updated 6 years ago
• wangz10 / contrastive_loss
  Experiments with supervised contrastive learning methods with different loss functions
  ☆224Updated 3 years ago
• CyberZHG / torch-multi-head-attention
  Multi-head attention in PyTorch
  ☆156Updated 6 years ago
• iffsid / mmvae
  Multimodal Mixture-of-Experts VAE
  ☆221Updated 2 years ago
• Linear95 / CLUB
  Code for ICML2020 paper - CLUB: A Contrastive Log-ratio Upper Bound of Mutual Information
  ☆353Updated last year
• lucidrains / h-transformer-1d
  Implementation of H-Transformer-1D, Hierarchical Attention for Sequence Learning
  ☆167Updated last year
• mathiaszinnen / focal_loss_torch
  Simple pytorch implementation of focal loss
  ☆86Updated 2 years ago
• samiraabnar / attention_flow
  ☆264Updated 4 years ago
• akashe / Multimodal-action-recognition
  Code on selecting an action based on multimodal inputs. Here in this case inputs are voice and text.
  ☆73Updated 4 years ago
• alex-matton / causal-transformer-decoder
  ☆73Updated 4 years ago
• jefflai108 / Contrastive-Predictive-Coding-PyTorch
  Contrastive Predictive Coding for Automatic Speaker Verification
  ☆506Updated 6 years ago
• AdeelH / pytorch-multi-class-focal-loss
  An (unofficial) implementation of Focal Loss, as described in the RetinaNet paper, generalized to the multi-class case.
  ☆239Updated 2 years ago
• GuillaumeErhard / Supervised_contrastive_loss_pytorch
  Independent implementation of Supervised Contrastive Loss. Straight to the point and beyond
  ☆85Updated 5 years ago
• WeiChengTseng / Pytorch-PCGrad
  Pytorch reimplementation for "Gradient Surgery for Multi-Task Learning"
  ☆394Updated 4 years ago
• kaiwenzha / Rank-N-Contrast
  [NeurIPS 2023, Spotlight] Rank-N-Contrast: Learning Continuous Representations for Regression
  ☆135Updated last year
• karamarieliu / cvqvae
  Conditional VQ-VAE
  ☆17Updated 6 years ago
• wuch15 / Fastformer
  A pytorch &keras implementation and demo of Fastformer.
  ☆191Updated 3 years ago
• salesforce / hierarchicalContrastiveLearning
  ☆163Updated 7 months ago
• Spijkervet / contrastive-predictive-coding
  PyTorch implementation of Representation Learning with Contrastive Predictive Coding by Van den Oord et al. (2018)
  ☆90Updated 4 years ago
• tadeephuy / GradientReversal
  Gradient Reversal Layer for Domain Adaptation
  ☆131Updated 3 years ago
• sooftware / pytorch-lr-scheduler
  PyTorch implementation of some learning rate schedulers for deep learning researcher.
  ☆91Updated 3 years ago
• miguelsvasco / gmc
  Official Implementation of "Geometric Multimodal Contrastive Representation Learning" (https://arxiv.org/abs/2202.03390)
  ☆28Updated last year
• Hzfinfdu / Diffusion-BERT
  ACL'2023: DiffusionBERT: Improving Generative Masked Language Models with Diffusion Models
  ☆339Updated last year
• lucidrains / mlm-pytorch
  An implementation of masked language modeling for Pytorch, made as concise and simple as possible
  ☆181Updated 2 years ago