Skumarr53 / Attention-is-All-you-Need-PyTorch
Repo has PyTorch implementation "Attention is All you Need - Transformers" paper for Machine Translation from French queries to English.
☆70Updated 4 years ago
Alternatives and similar repositories for Attention-is-All-you-Need-PyTorch:
Users that are interested in Attention-is-All-you-Need-PyTorch are comparing it to the libraries listed below
- [ICML 2020] code for "PowerNorm: Rethinking Batch Normalization in Transformers" https://arxiv.org/abs/2003.07845☆119Updated 3 years ago
- Guide for both TensorFlow and PyTorch in comparative way☆108Updated 5 years ago
- An education step by step implementation of SimCLR that accompanies the blogpost☆32Updated 2 years ago
- A simple to use pytorch wrapper for contrastive self-supervised learning on any neural network☆133Updated 4 years ago
- ☆28Updated 5 years ago
- A PyTorch implementation of the paper - "Synthesizer: Rethinking Self-Attention in Transformer Models"☆73Updated 2 years ago
- Implementation of Feedback Transformer in Pytorch☆105Updated 4 years ago
- ☆76Updated 5 years ago
- Implementation of modern data augmentation techniques in TensorFlow 2.x to be used in your training pipeline.☆34Updated 4 years ago
- Stochastic Weight Averaging Tutorials using pytorch.☆33Updated 4 years ago
- Contains code for the paper "Vision Transformers are Robust Learners" (AAAI 2022).☆126Updated 2 years ago
- Implementing SYNTHESIZER: Rethinking Self-Attention in Transformer Models using Pytorch☆70Updated 4 years ago
- Implementation of Online Label Smoothing in PyTorch☆94Updated 2 years ago
- [ICML 2020] code for the flooding regularizer proposed in "Do We Need Zero Training Loss After Achieving Zero Training Error?"☆91Updated 2 years ago
- Experiments with supervised contrastive learning methods with different loss functions☆219Updated 2 years ago
- Graph neural network message passing reframed as a Transformer with local attention☆68Updated 2 years ago
- Semantic Segmentation with Pytorch-Lightning☆63Updated 4 years ago
- [IN PROGRESS] An introduction to generative adversarial networks (GANs) and variational autoencoders (VAEs) in PyTorch, by implementing a…☆32Updated 6 years ago
- Awesome Contrastive Learning for CV & NLP☆162Updated 3 years ago
- A simple and working implementation of Electra, the fastest way to pretrain language models from scratch, in Pytorch☆224Updated last year
- Official PyTorch implementation of the paper "Self-Supervised Relational Reasoning for Representation Learning", NeurIPS 2020 Spotlight.☆142Updated 11 months ago
- An implementation of 2021 paper by Geoffrey Hinton: "How to represent part-whole hierarchies in a neural network" in Pytorch.☆58Updated 4 years ago
- Code for Multi-Head Attention: Collaborate Instead of Concatenate☆152Updated last year
- Implementation of Memformer, a Memory-augmented Transformer, in Pytorch☆115Updated 4 years ago
- Notebook for comprehensive analysis of authors, organizations, and countries of ICML 2020 papers.☆55Updated 4 years ago
- image captioning trained using COCO dataset in pytorch☆35Updated 5 years ago
- A simple recipe for training and inferencing Transformer architecture for Multi-Task Learning on custom datasets. You can find two approa…☆95Updated 2 years ago
- A guide that integrates Pytorch DistributedDataParallel, Apex, warmup, learning rate scheduler, also mentions the set-up of early-stoppin …☆64Updated 2 years ago
- Using Pytorch's nn.Transformer module to create an english to french neural machine translation model.☆77Updated 4 years ago
- https://cs330.stanford.edu/☆62Updated 2 years ago