guocheng2025 / Transformer-EncoderLinks
Implementation of Transformer encoder in PyTorch
☆67Updated 4 years ago
Alternatives and similar repositories for Transformer-Encoder
Users that are interested in Transformer-Encoder are comparing it to the libraries listed below
Sorting:
- Implement the paper "Self-Attention with Relative Position Representations"☆135Updated 4 years ago
- PyTorch implementation of "data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Language" from Meta AI☆182Updated 2 years ago
- Transformer-based Conditional Variational Autoencoder for Controllable Story Generation☆155Updated 3 years ago
- pytorch; mask language model ; bert☆72Updated 5 years ago
- A simple cross attention that updates both the source and target in one step☆172Updated last week
- Experiments with supervised contrastive learning methods with different loss functions☆220Updated 2 years ago
- Code on selecting an action based on multimodal inputs. Here in this case inputs are voice and text.☆73Updated 4 years ago
- A library for making Transformer Variational Autoencoders. (Extends the Huggingface/transformers library.)☆142Updated 4 years ago
- Multi-head attention in PyTorch☆153Updated 6 years ago
- PyTorch implementation of the InfoNCE loss for self-supervised learning.☆574Updated last year
- PyTorch implementation of some attentions for Deep Learning Researchers.☆534Updated 3 years ago
- ☆160Updated last month
- ☆73Updated 4 years ago
- Contrastive Predictive Coding for Automatic Speaker Verification☆498Updated 5 years ago
- Implementation of H-Transformer-1D, Hierarchical Attention for Sequence Learning☆163Updated last year
- Independent implementation of Supervised Contrastive Loss. Straight to the point and beyond☆81Updated 4 years ago
- Multimodal Mixture-of-Experts VAE☆213Updated 2 years ago
- PyTorch implementation of Representation Learning with Contrastive Predictive Coding by Van den Oord et al. (2018)☆86Updated 3 years ago
- Code for ICML2020 paper - CLUB: A Contrastive Log-ratio Upper Bound of Mutual Information☆340Updated last year
- ☆206Updated 3 years ago
- PyTorch implementation of the models described in the IEEE ICASSP 2022 paper "Is cross-attention preferable to self-attention for multi-m…☆61Updated 4 months ago
- ☆245Updated 3 years ago
- Simple pytorch implementation of focal loss☆86Updated 2 years ago
- An implementation of masked language modeling for Pytorch, made as concise and simple as possible☆179Updated last year
- Open source code for paper "Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hypersphere" ICML 2…☆449Updated 3 years ago
- Transformer implementation in PyTorch.☆493Updated 6 years ago
- A pytorch &keras implementation and demo of Fastformer.☆189Updated 2 years ago
- A minimal pytorch package implementing a gradient reversal layer.☆158Updated 9 months ago
- This is a pytorch implementation of k-means clustering algorithm☆316Updated 5 months ago
- PyTorch implementation of some learning rate schedulers for deep learning researcher.☆90Updated 2 years ago