guocheng2025 / Transformer-EncoderLinks
Implementation of Transformer encoder in PyTorch
☆71Updated 5 years ago
Alternatives and similar repositories for Transformer-Encoder
Users that are interested in Transformer-Encoder are comparing it to the libraries listed below
Sorting:
- Transformer-based Conditional Variational Autoencoder for Controllable Story Generation☆164Updated 3 years ago
- PyTorch implementation of some attentions for Deep Learning Researchers.☆547Updated 3 years ago
- Multi-head attention in PyTorch☆156Updated 6 years ago
- Implement the paper "Self-Attention with Relative Position Representations"☆139Updated 5 years ago
- PyTorch implementation of "data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Language" from Meta AI☆184Updated 2 years ago
- pytorch； mask language model ； bert☆73Updated 6 years ago
- PyTorch implementation of the InfoNCE loss for self-supervised learning.☆606Updated 2 years ago
- A library for making Transformer Variational Autoencoders. (Extends the Huggingface/transformers library.)☆146Updated 4 years ago
- Implementation of H-Transformer-1D, Hierarchical Attention for Sequence Learning☆167Updated last year
- A simple cross attention that updates both the source and target in one step☆195Updated 6 months ago
- PyTorch implementation of some learning rate schedulers for deep learning researcher.☆91Updated 3 years ago
- Experiments with supervised contrastive learning methods with different loss functions☆224Updated 3 years ago
- ☆73Updated 4 years ago
- Unofficial implementation of Google's FNet: Mixing Tokens with Fourier Transforms☆261Updated 4 years ago
- Code on selecting an action based on multimodal inputs. Here in this case inputs are voice and text.☆73Updated 4 years ago
- star_transformer pytorch☆27Updated 6 years ago
- Independent implementation of Supervised Contrastive Loss. Straight to the point and beyond☆85Updated 5 years ago
- My take on a practical implementation of Linformer for Pytorch.☆422Updated 3 years ago
- Implementation of the Transformer variant proposed in "Transformer Quality in Linear Time"☆372Updated 2 years ago
- Multimodal Mixture-of-Experts VAE☆221Updated 2 years ago
- ☆212Updated 4 years ago
- A Faster Pytorch Implementation of Multi-Head Self-Attention☆76Updated 3 years ago
- An (unofficial) implementation of Focal Loss, as described in the RetinaNet paper, generalized to the multi-class case.☆239Updated 2 years ago
- An implementation of masked language modeling for Pytorch, made as concise and simple as possible☆181Updated 2 years ago
- PyTorch implementation of Representation Learning with Contrastive Predictive Coding by Van den Oord et al. (2018)☆90Updated 4 years ago
- PyTorch implementation of beam search decoding for seq2seq models☆338Updated 3 years ago
- Contrastive Predictive Coding for Automatic Speaker Verification☆506Updated 6 years ago
- PyTorch implementation of the models described in the IEEE ICASSP 2022 paper "Is cross-attention preferable to self-attention for multi-m…☆63Updated 10 months ago
- Learning Rate Warmup in PyTorch☆415Updated 7 months ago
- ☆163Updated 7 months ago