ictnlp / awesome-transformerLinks
A collection of transformer's guides, implementations and variants.
☆106Updated 5 years ago
Alternatives and similar repositories for awesome-transformer
Users that are interested in awesome-transformer are comparing it to the libraries listed below
Sorting:
- Worth-reading papers and related resources on attention mechanism, Transformer and pretrained language model (PLM) such as BERT. 值得一读的注意力…☆130Updated 4 years ago
- Code for the paper "Are Sixteen Heads Really Better than One?"☆172Updated 5 years ago
- For the code release of our arXiv paper "Revisiting Few-sample BERT Fine-tuning" (https://arxiv.org/abs/2006.05987).☆185Updated 2 years ago
- ICLR2019, Multilingual Neural Machine Translation with Knowledge Distillation☆70Updated 5 years ago
- This project attempts to maintain the SOTA performance in machine translation☆108Updated 5 years ago
- Source code for "Efficient Training of BERT by Progressively Stacking"☆113Updated 6 years ago
- DisCo Transformer for Non-autoregressive MT☆77Updated 3 years ago
- A simple module consistently outperforms self-attention and Transformer model on main NMT datasets with SoTA performance.☆85Updated 2 years ago
- Code for the RecAdam paper: Recall and Learn: Fine-tuning Deep Pretrained Language Models with Less Forgetting.☆118Updated 4 years ago
- Source Code for ACL2019 paper <Bridging the Gap between Training and Inference for Neural Machine Translation>☆41Updated 4 years ago
- a simple yet complete implementation of the popular BERT model☆128Updated 5 years ago
- A PyTorch implementation of Transformer in "Attention is All You Need"☆106Updated 4 years ago
- Understanding the Difficulty of Training Transformers☆330Updated 3 years ago
- Transformers without Tears: Improving the Normalization of Self-Attention☆133Updated last year
- Unicoder model for understanding and generation.☆91Updated last year
- Source code of paper "BP-Transformer: Modelling Long-Range Context via Binary Partitioning"☆128Updated 4 years ago
- Pytorch implementation of Bert and Pals: Projected Attention Layers for Efficient Adaptation in Multi-Task Learning (https://arxiv.org/ab…☆84Updated 6 years ago
- Neutron: A pytorch based implementation of Transformer and its variants.☆64Updated 2 years ago
- ☆32Updated 4 years ago
- Data and code used in our NAACL'19 paper "Selective Attention for Context-aware Neural Machine Translation"☆30Updated 5 years ago
- Source code to reproduce the results in the ACL 2019 paper "Syntactically Supervised Transformers for Faster Neural Machine Translation"☆81Updated 3 years ago
- ☆93Updated 4 years ago
- ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators☆91Updated 4 years ago
- [ACL‘20] Highway Transformer: A Gated Transformer.☆32Updated 3 years ago
- Code for the paper "A Theoretical Analysis of the Repetition Problem in Text Generation" in AAAI 2021.☆54Updated 2 years ago
- LAMB Optimizer for Large Batch Training (TensorFlow version)☆121Updated 5 years ago
- ☆84Updated 5 years ago
- ☆22Updated 4 years ago
- Zero -- A neural machine translation system☆153Updated 2 years ago
- ☆13Updated 6 years ago