Skumarr53 / Attention-is-All-you-Need-PyTorch
Repo has PyTorch implementation "Attention is All you Need - Transformers" paper for Machine Translation from French queries to English.
☆70Updated 4 years ago
Alternatives and similar repositories for Attention-is-All-you-Need-PyTorch:
Users that are interested in Attention-is-All-you-Need-PyTorch are comparing it to the libraries listed below
- A simple to use pytorch wrapper for contrastive self-supervised learning on any neural network☆135Updated 4 years ago
- ☆76Updated 5 years ago
- Building a RNN and LSTM from scratch with NumPy.☆42Updated 10 months ago
- RNN Encoder-Decoder in PyTorch☆44Updated 9 months ago
- An education step by step implementation of SimCLR that accompanies the blogpost☆32Updated 3 years ago
- Implementation of Feedback Transformer in Pytorch☆105Updated 4 years ago
- Implementation of modern data augmentation techniques in TensorFlow 2.x to be used in your training pipeline.☆34Updated 4 years ago
- Pseudo Labeling for Neural Networks and Logistic Regression/SVMs ( Based on "Pseudo-Label : The Simple and Efficient Semi-Supervised Lear…☆73Updated 5 years ago
- Semantic Segmentation with Pytorch-Lightning☆63Updated 4 years ago
- [ICML 2021 Oral] We show pure attention suffers rank collapse, and how different mechanisms combat it.☆164Updated 4 years ago
- Experiments with supervised contrastive learning methods with different loss functions☆220Updated 2 years ago
- Guide for both TensorFlow and PyTorch in comparative way☆108Updated 5 years ago
- A PyTorch implementation of the paper - "Synthesizer: Rethinking Self-Attention in Transformer Models"☆73Updated 2 years ago
- (Minimally) implements SimCLR (https://arxiv.org/abs/2002.05709) in TensorFlow 2.☆90Updated 4 years ago
- Implementing SYNTHESIZER: Rethinking Self-Attention in Transformer Models using Pytorch☆70Updated 4 years ago
- Using Pytorch's nn.Transformer module to create an english to french neural machine translation model.☆77Updated 4 years ago
- Code for Multi-Head Attention: Collaborate Instead of Concatenate☆151Updated last year
- ☆28Updated 5 years ago
- A simple implementation of Batch Normalization using pytorch.☆45Updated 4 years ago
- A PyTorch Implementation of Focal Loss.☆15Updated 6 years ago
- Pytorch implementation of the image transformer for unconditional image generation☆118Updated 9 months ago
- A PyTorch implementation of Transformer in "Attention is All You Need"☆105Updated 4 years ago
- Recurrent neural networks: building a custom LSTM/GRU cell in PyTorch☆28Updated 4 years ago
- Transformer-based Conditional Variational Autoencoder for Controllable Story Generation☆155Updated 2 years ago
- Implementation of Fast Transformer in Pytorch☆173Updated 3 years ago
- Implementation of Memformer, a Memory-augmented Transformer, in Pytorch☆115Updated 4 years ago
- Neural Machine Translation with Attention (PyTorch)☆45Updated 6 years ago
- PyTorch implementation of beam search decoding for seq2seq models☆337Updated 2 years ago
- PyTorch Implementation of OpenAI's Image GPT☆256Updated last year
- PyTorch implementation of "Effective Approaches to Attention-based Neural Machine Translation" using scheduled sampling to improve the pa…☆20Updated 6 years ago