Kyubyong / transformer
A TensorFlow Implementation of the Transformer: Attention Is All You Need
☆4,358Updated last year
Alternatives and similar repositories for transformer:
Users that are interested in transformer are comparing it to the libraries listed below
- ☆3,644Updated 2 years ago
- A PyTorch implementation of the Transformer model in "Attention is All You Need".☆9,141Updated last year
- Google AI 2018 BERT pytorch implementation☆6,375Updated last year
- some attention implements☆1,446Updated 5 years ago
- LSTM and QRNN Language Model Toolkit for PyTorch☆1,974Updated 3 years ago
- XLNet: Generalized Autoregressive Pretraining for Language Understanding☆6,187Updated last year
- Open Source Neural Machine Translation and (Large) Language Models in PyTorch☆6,866Updated last month
- Pytorch implementations of various Deep NLP models in cs-224n(Stanford Univ)☆2,954Updated 5 years ago
- Transformer seq2seq model, program that can build a language translator from parallel corpus☆1,393Updated last year
- TensorFlow Neural Machine Translation Tutorial☆6,419Updated 2 years ago
- Library of deep learning models and datasets designed to make deep learning more accessible and accelerate ML research.☆16,080Updated last year
- Keras Attention Layer (Luong and Bahdanau scores).☆2,810Updated last year
- Implementation of BERT that could load official pre-trained models for feature extraction and prediction☆2,421Updated 3 years ago
- Training RNNs as Fast as CNNs (https://arxiv.org/abs/1709.02755)☆2,101Updated 3 years ago
- ALBERT: A Lite BERT for Self-supervised Learning of Language Representations☆3,269Updated 2 years ago
- Unsupervised Word Segmentation for Neural Machine Translation and Text Generation☆2,230Updated 8 months ago
- An open source framework for seq2seq models in PyTorch.☆1,509Updated 2 years ago
- An annotated implementation of the Transformer paper.☆6,181Updated last year
- Code and model for the paper "Improving Language Understanding by Generative Pre-Training"☆2,206Updated 6 years ago
- An open-source NLP research library, built on PyTorch.☆11,837Updated 2 years ago
- PyTorch original implementation of Cross-lingual Language Model Pretraining.☆2,905Updated 2 years ago
- A Keras+TensorFlow Implementation of the Transformer: Attention Is All You Need☆712Updated 3 years ago
- Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.☆3,082Updated last year
- Tensorflow implementation of contextualized word representations from bi-directional language models☆1,619Updated 2 years ago
- tensorboard for pytorch (and chainer, mxnet, numpy, ...)☆7,932Updated this week
- Models, data loaders and abstractions for language processing, powered by PyTorch☆3,538Updated this week
- Implementation of Sequence Generative Adversarial Nets with Policy Gradient☆2,090Updated 6 years ago
- Sequence to Sequence Learning with Keras☆3,177Updated 2 years ago
- Multi-Task Deep Neural Networks for Natural Language Understanding☆2,252Updated last year
- A general-purpose encoder-decoder framework for Tensorflow☆5,621Updated 4 years ago