guocheng18 / Transformer-Encoder
Implementation of Transformer encoder in PyTorch
☆60Updated 4 years ago
Related projects ⓘ
Alternatives and complementary repositories for Transformer-Encoder
- pytorch； mask language model ； bert☆70Updated 4 years ago
- Transformer-based Conditional Variational Autoencoder for Controllable Story Generation☆146Updated 2 years ago
- Implement the paper "Self-Attention with Relative Position Representations"☆124Updated 3 years ago
- Multi-head attention in PyTorch☆147Updated 5 years ago
- Code on selecting an action based on multimodal inputs. Here in this case inputs are voice and text.☆70Updated 3 years ago
- PyTorch implementation of "data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Language" from Meta AI☆172Updated last year
- Code for "Finetuning Pretrained Transformers into Variational Autoencoders"☆36Updated 2 years ago
- A library for making Transformer Variational Autoencoders. (Extends the Huggingface/transformers library.)☆131Updated 3 years ago
- Experiments with supervised contrastive learning methods with different loss functions☆214Updated last year
- Independent implementation of Supervised Contrastive Loss. Straight to the point and beyond☆75Updated 3 years ago
- A simple cross attention that updates both the source and target in one step☆150Updated 6 months ago
- Transformer-Based Conditioned Variational Autoencoder for Story Completion☆94Updated 4 years ago
- PyTorch implementation for Seq2Seq model with attention and Greedy Search / Beam Search for neural machine translation☆58Updated 3 years ago
- Using Pytorch's nn.Transformer module to create an english to french neural machine translation model.☆77Updated 4 years ago
- a pytorch implementation of self-attention with relative position representations☆51Updated 3 years ago
- Pytorch implementation of SMIL: Multimodal Learning with Severely Missing Modality (AAAI 2021)☆91Updated 2 years ago
- A pytorch &keras implementation and demo of Fastformer.☆188Updated 2 years ago
- Modulated Fusion using Transformer for Linguistic-Acoustic Emotion Recognition☆30Updated 3 years ago
- Implementation of H-Transformer-1D, Hierarchical Attention for Sequence Learning☆155Updated 8 months ago
- PyTorch implementation of some attentions for Deep Learning Researchers.☆513Updated 2 years ago
- ☆72Updated 3 years ago
- Code for NAACL 2021 paper: MTAG: Modal-Temporal Attention Graph for Unaligned Human Multimodal Language Sequences☆43Updated last year
- Official Implementation of "Geometric Multimodal Contrastive Representation Learning" (https://arxiv.org/abs/2202.03390)☆26Updated 2 years ago
- Unofficial implementation of Google's FNet: Mixing Tokens with Fourier Transforms☆251Updated 3 years ago
- Minimal RNN classifier with self-attention in Pytorch☆148Updated 2 years ago
- PyTorch implementation of some learning rate schedulers for deep learning researcher.☆86Updated 2 years ago
- [ICLR 2019] Learning Factorized Multimodal Representations☆67Updated 4 years ago
- PyTorch implementation of the models described in the IEEE ICASSP 2022 paper "Is cross-attention preferable to self-attention for multi-m…☆54Updated 2 years ago
- Pytorch Implementation of "Adaptive Co-attention Network for Named Entity Recognition in Tweets" (AAAI 2018)☆57Updated last year
- Conditionally Adaptive Multi-Task Learning: Improving Transfer Learning in NLP Using Fewer Parameters & Less Data☆56Updated 3 years ago