Kyubyong / transformer
A TensorFlow Implementation of the Transformer: Attention Is All You Need
☆4,279Updated last year
Related projects ⓘ
Alternatives and complementary repositories for transformer
- Google AI 2018 BERT pytorch implementation☆6,213Updated last year
- A PyTorch implementation of the Transformer model in "Attention is All You Need".☆8,846Updated 6 months ago
- ☆3,611Updated 2 years ago
- Library of deep learning models and datasets designed to make deep learning more accessible and accelerate ML research.☆15,514Updated last year
- XLNet: Generalized Autoregressive Pretraining for Language Understanding☆6,181Updated last year
- An annotated implementation of the Transformer paper.☆5,701Updated 7 months ago
- Pytorch implementations of various Deep NLP models in cs-224n(Stanford Univ)☆2,956Updated 5 years ago
- some attention implements☆1,433Updated 4 years ago
- Sequence modeling benchmarks and temporal convolutional networks☆4,165Updated 2 years ago
- An open source framework for seq2seq models in PyTorch.☆1,498Updated last year
- Implementation of BERT that could load official pre-trained models for feature extraction and prediction☆2,430Updated 2 years ago
- tensorboard for pytorch (and chainer, mxnet, numpy, ...)☆7,870Updated 2 months ago
- Models, data loaders and abstractions for language processing, powered by PyTorch☆3,513Updated this week
- bert nlp papers, applications and github resources, including the newst xlnet ， BERT、XLNet 相关论文和 github 项目☆1,849Updated 3 years ago
- A LITE BERT FOR SELF-SUPERVISED LEARNING OF LANGUAGE REPRESENTATIONS, 海量中文预训练ALBERT模型☆3,927Updated last year
- LSTM and QRNN Language Model Toolkit for PyTorch☆1,960Updated 2 years ago
- Open Source Neural Machine Translation and (Large) Language Models in PyTorch☆6,763Updated 4 months ago
- TensorFlow Neural Machine Translation Tutorial☆6,386Updated 2 years ago
- Transformer seq2seq model, program that can build a language translator from parallel corpus☆1,345Updated last year
- An open-source NLP research library, built on PyTorch.☆11,756Updated last year
- ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators☆2,336Updated 7 months ago
- all kinds of text classification models and more with deep learning☆7,859Updated last year
- Official implementations for various pre-training models of ERNIE-family, covering topics of Language Understanding & Generation, Multimo…☆6,311Updated 2 months ago
- Multi-Task Deep Neural Networks for Natural Language Understanding☆2,235Updated 8 months ago
- Must-read Papers on pre-trained language models.☆3,321Updated 2 years ago
- Unsupervised Word Segmentation for Neural Machine Translation and Text Generation☆2,195Updated 3 months ago
- BertViz: Visualize Attention in NLP Models (BERT, GPT2, BART, etc.)☆6,919Updated last year
- Implementation of Sequence Generative Adversarial Nets with Policy Gradient☆2,091Updated 5 years ago
- Training RNNs as Fast as CNNs (https://arxiv.org/abs/1709.02755)☆2,106Updated 2 years ago
- ALBERT: A Lite BERT for Self-supervised Learning of Language Representations☆3,245Updated last year