guocheng2025 / Transformer-EncoderLinks
Implementation of Transformer encoder in PyTorch
☆70Updated 5 years ago
Alternatives and similar repositories for Transformer-Encoder
Users that are interested in Transformer-Encoder are comparing it to the libraries listed below
Sorting:
- Transformer-based Conditional Variational Autoencoder for Controllable Story Generation☆161Updated 3 years ago
- PyTorch implementation of "data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Language" from Meta AI☆184Updated 2 years ago
- Implement the paper "Self-Attention with Relative Position Representations"☆139Updated 5 years ago
- A library for making Transformer Variational Autoencoders. (Extends the Huggingface/transformers library.)☆144Updated 4 years ago
- pytorch； mask language model ； bert☆72Updated 6 years ago
- Multi-head attention in PyTorch☆156Updated 6 years ago
- A simple cross attention that updates both the source and target in one step☆191Updated 5 months ago
- Code for "Finetuning Pretrained Transformers into Variational Autoencoders"☆40Updated 3 years ago
- ☆73Updated 4 years ago
- PyTorch implementation of the InfoNCE loss for self-supervised learning.☆604Updated 2 years ago
- Multimodal Mixture-of-Experts VAE☆220Updated 2 years ago
- Code on selecting an action based on multimodal inputs. Here in this case inputs are voice and text.☆73Updated 4 years ago
- A pytorch &keras implementation and demo of Fastformer.☆191Updated 3 years ago
- Implementation of H-Transformer-1D, Hierarchical Attention for Sequence Learning☆167Updated last year
- PyTorch implementation of some learning rate schedulers for deep learning researcher.☆91Updated 3 years ago
- Experiments with supervised contrastive learning methods with different loss functions☆223Updated 3 years ago
- PyTorch implementation of Representation Learning with Contrastive Predictive Coding by Van den Oord et al. (2018)☆89Updated 4 years ago
- Independent implementation of Supervised Contrastive Loss. Straight to the point and beyond☆85Updated 5 years ago
- An implementation of masked language modeling for Pytorch, made as concise and simple as possible☆179Updated 2 years ago
- This repository summarizes techniques for KL divergence vanishing problem.☆30Updated 6 years ago
- Implementation of Memformer, a Memory-augmented Transformer, in Pytorch☆126Updated 5 years ago
- Code for ICML2020 paper - CLUB: A Contrastive Log-ratio Upper Bound of Mutual Information☆353Updated last year
- Simple pytorch implementation of focal loss☆86Updated 2 years ago
- Unofficial implementation of Google's FNet: Mixing Tokens with Fourier Transforms☆260Updated 4 years ago
- An (unofficial) implementation of Focal Loss, as described in the RetinaNet paper, generalized to the multi-class case.☆239Updated last year
- Implementation of Linformer for Pytorch☆303Updated 2 years ago
- My take on a practical implementation of Linformer for Pytorch.☆421Updated 3 years ago
- Contrastive Predictive Coding for Automatic Speaker Verification☆506Updated 6 years ago
- ☆212Updated 4 years ago
- [NeurIPS 2023] Factorized Contrastive Learning: Going Beyond Multi-view Redundancy☆74Updated 2 years ago