guocheng2025 / Transformer-Encoder
Implementation of Transformer encoder in PyTorch
☆66Updated 4 years ago
Alternatives and similar repositories for Transformer-Encoder:
Users that are interested in Transformer-Encoder are comparing it to the libraries listed below
- Transformer-based Conditional Variational Autoencoder for Controllable Story Generation☆155Updated 2 years ago
- Implement the paper "Self-Attention with Relative Position Representations"☆128Updated 4 years ago
- pytorch； mask language model ； bert☆72Updated 5 years ago
- Code for "Finetuning Pretrained Transformers into Variational Autoencoders"☆39Updated 2 years ago
- PyTorch implementation of "data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Language" from Meta AI☆177Updated last year
- Modulated Fusion using Transformer for Linguistic-Acoustic Emotion Recognition☆30Updated 4 years ago
- Multi-head attention in PyTorch☆152Updated 6 years ago
- Code on selecting an action based on multimodal inputs. Here in this case inputs are voice and text.☆73Updated 3 years ago
- A library for making Transformer Variational Autoencoders. (Extends the Huggingface/transformers library.)☆138Updated 3 years ago
- ☆200Updated 3 years ago
- Implementation of H-Transformer-1D, Hierarchical Attention for Sequence Learning☆160Updated last year
- A simple cross attention that updates both the source and target in one step☆169Updated 11 months ago
- [ICLR 2019] Learning Factorized Multimodal Representations☆67Updated 4 years ago
- Implementing SYNTHESIZER: Rethinking Self-Attention in Transformer Models using Pytorch☆70Updated 4 years ago
- Code for NAACL 2021 paper: MTAG: Modal-Temporal Attention Graph for Unaligned Human Multimodal Language Sequences☆42Updated 2 years ago
- ☆48Updated 6 years ago
- PyTorch implementation of some attentions for Deep Learning Researchers.☆531Updated 3 years ago
- PyTorch implementation of the models described in the IEEE ICASSP 2022 paper "Is cross-attention preferable to self-attention for multi-m…☆58Updated 3 weeks ago
- PyTorch implementation for Seq2Seq model with attention and Greedy Search / Beam Search for neural machine translation☆58Updated 4 years ago
- Independent implementation of Supervised Contrastive Loss. Straight to the point and beyond☆80Updated 4 years ago
- a pytorch implementation of self-attention with relative position representations☆50Updated 4 years ago
- Transformer-Based Conditioned Variational Autoencoder for Story Completion☆94Updated 4 years ago
- A PyTorch implementation of the paper - "Synthesizer: Rethinking Self-Attention in Transformer Models"☆73Updated 2 years ago
- Implementation of Memformer, a Memory-augmented Transformer, in Pytorch☆115Updated 4 years ago
- Pytorch Implementation of "Adaptive Co-attention Network for Named Entity Recognition in Tweets" (AAAI 2018)☆57Updated last year
- Implementation of Fast Transformer in Pytorch☆173Updated 3 years ago
- Context Modeling with Speaker's Pre-trained Memory Tracking for Emotion Recognition in Conversation (NAACL 2022)☆63Updated 2 years ago
- Axial Positional Embedding for Pytorch☆78Updated 2 months ago
- my codes for learning attention mechanism☆50Updated 4 years ago
- Hierarchical Question-Image Co-Attention for Visual Question Answering☆24Updated 5 years ago