maknotavailable / pytorch-pretrained-BERT
A PyTorch implementation of Google AI's BERT model provided with Google's pre-trained models, examples and utilities.
☆68Updated 2 years ago
Related projects: ⓘ
- ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators☆91Updated 3 years ago
- A PyTorch implementation of Google AI's BERT model provided with Google's pre-trained models, examples and utilities.☆35Updated 5 years ago
- Unicoder model for understanding and generation.☆88Updated 9 months ago
- [EMNLP 2019] Mixture Content Selection for Diverse Sequence Generation (Question Generation / Abstractive Summarization)☆113Updated 3 years ago
- Research code for ACL 2020 paper: "Distilling Knowledge Learned in BERT for Text Generation".☆129Updated 3 years ago
- AAAI-20 paper: Cross-Lingual Natural Language Generation via Pre-Training☆128Updated 3 years ago
- text generation based on transformer☆36Updated 5 years ago
- Code for the paper "Are Sixteen Heads Really Better than One?"☆165Updated 4 years ago
- ☆95Updated 4 years ago
- Pytorch Implementation of ALBERT(A Lite BERT for Self-supervised Learning of Language Representations)☆225Updated 3 years ago
- Reinforcement Learning Based Text Style Transfer without Parallel Training Corpus☆27Updated 5 years ago
- A PyTorch implementation of Transformer in "Attention is All You Need"☆103Updated 3 years ago
- Code associated with the "Data Augmentation using Pre-trained Transformer Models" paper☆131Updated last year
- Worth-reading papers and related resources on attention mechanism, Transformer and pretrained language model (PLM) such as BERT. 值得一读的注意力…☆131Updated 3 years ago
- Survey on Machine Reading Comprehension☆150Updated 3 years ago
- Fork of huggingface/pytorch-pretrained-BERT for BERT on STILTs☆106Updated last year
- ☆172Updated 2 years ago
- CIKM 2020: Speaker-Aware BERT for Multi-Turn Response Selection in Retrieval-Based Chatbots☆75Updated 3 years ago
- Sequential Latent Knowledge Selection for Knowledge-Grounded Dialogue. In ICLR, 2020 (spotlight)☆129Updated 4 years ago
- Code for ACL 2019 paper: "Searching for Effective Neural Extractive Summarization: What Works and What's Next"☆91Updated 3 years ago
- PyTorch implementation of BERT in "BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding"☆94Updated 5 years ago
- For the code release of our arXiv paper "Revisiting Few-sample BERT Fine-tuning" (https://arxiv.org/abs/2006.05987).☆184Updated last year
- pytorch implementation for Patient Knowledge Distillation for BERT Model Compression☆198Updated 5 years ago
- Resources for the MRQA 2019 Shared Task☆290Updated 3 years ago
- Code for the RecAdam paper: Recall and Learn: Fine-tuning Deep Pretrained Language Models with Less Forgetting.☆114Updated 3 years ago
- Interpreting Bidirectional Encoder Representations from Transformers (BERT)☆107Updated last year
- PyTorch implementation for Seq2Seq model with attention and Greedy Search / Beam Search for neural machine translation☆57Updated 3 years ago
- ☆69Updated 3 years ago
- ☆211Updated 4 years ago
- CharBERT: Character-aware Pre-trained Language Model (COLING2020)☆117Updated 3 years ago