maknotavailable / pytorch-pretrained-BERTLinks
A PyTorch implementation of Google AI's BERT model provided with Google's pre-trained models, examples and utilities.
☆71Updated 3 years ago
Alternatives and similar repositories for pytorch-pretrained-BERT
Users that are interested in pytorch-pretrained-BERT are comparing it to the libraries listed below
Sorting:
- ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators☆91Updated 4 years ago
- PyTorch implementation of BERT in "BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding"☆109Updated 6 years ago
- A PyTorch implementation of Google AI's BERT model provided with Google's pre-trained models, examples and utilities.☆35Updated 6 years ago
- Pytorch Implementation of ALBERT(A Lite BERT for Self-supervised Learning of Language Representations)☆227Updated 4 years ago
- Code associated with the "Data Augmentation using Pre-trained Transformer Models" paper☆135Updated 2 years ago
- Unicoder model for understanding and generation.☆91Updated last year
- AAAI-20 paper: Cross-Lingual Natural Language Generation via Pre-Training☆129Updated 4 years ago
- Research code for ACL 2020 paper: "Distilling Knowledge Learned in BERT for Text Generation".☆131Updated 4 years ago
- For the code release of our arXiv paper "Revisiting Few-sample BERT Fine-tuning" (https://arxiv.org/abs/2006.05987).☆185Updated 2 years ago
- Code for the paper "Are Sixteen Heads Really Better than One?"☆172Updated 5 years ago
- Semantics-aware BERT for Language Understanding (AAAI 2020)☆289Updated 2 years ago
- Repository for the paper "Fast and Accurate Deep Bidirectional Language Representations for Unsupervised Learning"☆110Updated 4 years ago
- A PyTorch implementation of Transformer in "Attention is All You Need"☆106Updated 4 years ago
- [NAACL 2021] Factual Probing Is [MASK]: Learning vs. Learning to Recall https://arxiv.org/abs/2104.05240☆167Updated 2 years ago
- Code associated with the Don't Stop Pretraining ACL 2020 paper☆535Updated 3 years ago
- Source codes for the paper "Multi-View Sequence-to-Sequence Models with Conversational Structure for Abstractive Dialogue Summarization"☆91Updated last year
- MPNet: Masked and Permuted Pre-training for Language Understanding https://arxiv.org/pdf/2004.09297.pdf☆292Updated 4 years ago
- PyTorch implementation for Seq2Seq model with attention and Greedy Search / Beam Search for neural machine translation☆58Updated 4 years ago
- [EMNLP 2019] Mixture Content Selection for Diverse Sequence Generation (Question Generation / Abstractive Summarization)☆113Updated 4 years ago
- IEEE/ACM TASLP 2020: SBERT-WK: A Sentence Embedding Method By Dissecting BERT-based Word Models☆180Updated 4 years ago
- Code for ACL 2019 paper: "Searching for Effective Neural Extractive Summarization: What Works and What's Next"☆91Updated 4 years ago
- pytorch implementation for Patient Knowledge Distillation for BERT Model Compression☆203Updated 6 years ago
- With the aim of building next generation virtual assistants that can handle multimodal inputs and perform multimodal actions, we introduc…☆133Updated last year
- ☆81Updated 4 years ago
- ☆255Updated 2 years ago
- ☆161Updated 2 months ago
- Plot the vector graph of attention based text visualisation☆371Updated 6 years ago
- Worth-reading papers and related resources on attention mechanism, Transformer and pretrained language model (PLM) such as BERT. 值得一读的注意力…☆130Updated 4 years ago
- Source code for our "TitleStylist" paper at ACL 2020☆77Updated last year
- Official PyTorch Implementation of SSMix (Findings of ACL 2021)