Skumarr53 / Attention-is-All-you-Need-PyTorch
Repo has PyTorch implementation "Attention is All you Need - Transformers" paper for Machine Translation from French queries to English.
☆65Updated 4 years ago
Related projects ⓘ
Alternatives and complementary repositories for Attention-is-All-you-Need-PyTorch
- Experiments with supervised contrastive learning methods with different loss functions☆214Updated last year
- Implementing SYNTHESIZER: Rethinking Self-Attention in Transformer Models using Pytorch☆70Updated 4 years ago
- A simple to use pytorch wrapper for contrastive self-supervised learning on any neural network☆122Updated 3 years ago
- Implementation of Feedback Transformer in Pytorch☆104Updated 3 years ago
- Statistics and Visualization of acceptance rate, main keyword of CVPR 2020 accepted papers for the main Computer Vision conference (CVPR)☆33Updated 3 years ago
- Implementation of Memformer, a Memory-augmented Transformer, in Pytorch☆106Updated 3 years ago
- PyTorch Implementation of OpenAI GPT☆118Updated last year
- [ICML 2021 Oral] We show pure attention suffers rank collapse, and how different mechanisms combat it.☆161Updated 3 years ago
- Implementation of Fast Transformer in Pytorch☆171Updated 3 years ago
- ☆28Updated 4 years ago
- PyTorch Implementation of OpenAI's Image GPT☆254Updated last year
- Semantic Segmentation with Pytorch-Lightning☆63Updated 3 years ago
- An education step by step implementation of SimCLR that accompanies the blogpost☆31Updated 2 years ago
- An implementation of drophead regularization for pytorch transformers☆19Updated 3 years ago
- A PyTorch implementation of the paper Generative Adversarial Text-to-Image Synthesis☆25Updated 5 years ago
- AIMS 2020, class on Visual Recognition☆23Updated 4 years ago
- Code for Multi-Head Attention: Collaborate Instead of Concatenate☆150Updated last year
- Guide for both TensorFlow and PyTorch in comparative way☆108Updated 5 years ago
- A simple and working implementation of Electra, the fastest way to pretrain language models from scratch, in Pytorch☆222Updated last year
- Implementation of Memory-Compressed Attention, from the paper "Generating Wikipedia By Summarizing Long Sequences"☆71Updated last year
- ☆65Updated 3 years ago
- An implementation of 2021 paper by Geoffrey Hinton: "How to represent part-whole hierarchies in a neural network" in Pytorch.☆57Updated 3 years ago
- Notebook for comprehensive analysis of authors, organizations, and countries of ICML 2020 papers.☆54Updated 4 years ago
- Transformer-based Conditional Variational Autoencoder for Controllable Story Generation☆146Updated 2 years ago
- Stochastic Weight Averaging Tutorials using pytorch.☆33Updated 4 years ago
- [ICML 2020] code for the flooding regularizer proposed in "Do We Need Zero Training Loss After Achieving Zero Training Error?"☆91Updated last year
- Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch☆59Updated 3 years ago
- Pytorch implementation of Compressive Transformers, from Deepmind☆157Updated 3 years ago
- (Minimally) implements SimCLR (https://arxiv.org/abs/2002.05709) in TensorFlow 2.☆90Updated 3 years ago
- A guide that integrates Pytorch DistributedDataParallel, Apex, warmup, learning rate scheduler, also mentions the set-up of early-stoppin…☆60Updated 2 years ago