Kyubyong / transformer
A TensorFlow Implementation of the Transformer: Attention Is All You Need
☆4,328Updated last year
Alternatives and similar repositories for transformer:
Users that are interested in transformer are comparing it to the libraries listed below
- Google AI 2018 BERT pytorch implementation☆6,298Updated last year
- A PyTorch implementation of the Transformer model in "Attention is All You Need".☆9,013Updated 10 months ago
- XLNet: Generalized Autoregressive Pretraining for Language Understanding☆6,182Updated last year
- Library of deep learning models and datasets designed to make deep learning more accessible and accelerate ML research.☆15,847Updated last year
- some attention implements☆1,440Updated 5 years ago
- ☆3,635Updated 2 years ago
- Pytorch implementations of various Deep NLP models in cs-224n(Stanford Univ)☆2,954Updated 5 years ago
- Multi-Task Deep Neural Networks for Natural Language Understanding☆2,245Updated 11 months ago
- TensorFlow Neural Machine Translation Tutorial☆6,409Updated 2 years ago
- Unsupervised Word Segmentation for Neural Machine Translation and Text Generation☆2,219Updated 6 months ago
- Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.☆3,063Updated last year
- Code and model for the paper "Improving Language Understanding by Generative Pre-Training"☆2,189Updated 6 years ago
- Implementation of BERT that could load official pre-trained models for feature extraction and prediction☆2,423Updated 3 years ago
- Models, data loaders and abstractions for language processing, powered by PyTorch☆3,526Updated this week
- LSTM and QRNN Language Model Toolkit for PyTorch☆1,965Updated 3 years ago
- Facebook AI Research Sequence-to-Sequence Toolkit☆3,740Updated 3 years ago
- An annotated implementation of the Transformer paper.☆6,000Updated 10 months ago
- Open Source Neural Machine Translation and (Large) Language Models in PyTorch☆6,823Updated last month
- Implementation of Sequence Generative Adversarial Nets with Policy Gradient☆2,090Updated 5 years ago
- Training RNNs as Fast as CNNs (https://arxiv.org/abs/1709.02755)☆2,102Updated 3 years ago
- Official implementations for various pre-training models of ERNIE-family, covering topics of Language Understanding & Generation, Multimo…☆6,346Updated 5 months ago
- TensorFlow code and pre-trained models for BERT☆38,669Updated 6 months ago
- A general-purpose encoder-decoder framework for Tensorflow☆5,607Updated 4 years ago
- A LITE BERT FOR SELF-SUPERVISED LEARNING OF LANGUAGE REPRESENTATIONS, 海量中文预训练ALBERT模型☆3,949Updated 2 years ago
- PyTorch original implementation of Cross-lingual Language Model Pretraining.☆2,899Updated 2 years ago
- Transformer seq2seq model, program that can build a language translator from parallel corpus☆1,373Updated last year
- An open source framework for seq2seq models in PyTorch.☆1,506Updated 2 years ago
- An open-source NLP research library, built on PyTorch.☆11,806Updated 2 years ago
- Keras Attention Layer (Luong and Bahdanau scores).☆2,806Updated last year
- A machine translation reading list maintained by Tsinghua Natural Language Processing Group☆2,437Updated 6 months ago