laiguokun / bert-cloth
☆40Updated 4 years ago
Related projects: ⓘ
- ☆34Updated this week
- Source code of paper "BP-Transformer: Modelling Long-Range Context via Binary Partitioning"☆125Updated 3 years ago
- Transformer with Untied Positional Encoding (TUPE). Code of paper "Rethinking Positional Encoding in Language Pre-training". Improve exis…☆249Updated 2 years ago
- DeeBERT: Dynamic Early Exiting for Accelerating BERT Inference☆151Updated 2 years ago
- ☆80Updated last year
- Pretrain CPM-1☆50Updated 3 years ago
- Source code for "Efficient Training of BERT by Progressively Stacking"☆111Updated 5 years ago
- A plug-in of Microsoft DeepSpeed to fix the bug of DeepSpeed pipeline☆26Updated 3 years ago
- Code for the paper "Are Sixteen Heads Really Better than One?"☆165Updated 4 years ago
- Notes of my introduction about NLP in Fudan University☆37Updated 3 years ago
- ☆83Updated 4 years ago
- Must-read papers on improving efficiency for pre-trained language models.☆100Updated last year
- Differentiable Product Quantization for End-to-End Embedding Compression.☆58Updated last year
- Implementation of papers for text classification task on SST-1/SST-2☆62Updated last month
- Visualization for simple attention and Google's multi-head attention.☆68Updated 6 years ago
- ☆50Updated last year
- Code for the paper "BERT Loses Patience: Fast and Robust Inference with Early Exit".☆63Updated 3 years ago
- For the code release of our arXiv paper "Revisiting Few-sample BERT Fine-tuning" (https://arxiv.org/abs/2006.05987).☆184Updated last year
- Pytorch implementation of the methods proposed in **Adversarial Training Methods for Semi-Supervised Text Classification** on IMDB datase…☆41Updated 5 years ago
- ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators☆91Updated 3 years ago
- A simple yet strong implementation of neural machine translation in pytorch☆89Updated 3 years ago
- Deep learning images developed from nvidia/cuda-cudnn-devel-ubuntu.☆23Updated 2 years ago
- ☆69Updated 3 years ago
- Worth-reading papers and related resources on attention mechanism, Transformer and pretrained language model (PLM) such as BERT. 值得一读的注意力…☆131Updated 3 years ago
- Adversarial Training for Natural Language Understanding☆251Updated last year
- LiveBot: Generating Live Video Comments Based on Visual and Textual Contexts (AAAI 2019)☆122Updated 5 years ago
- "Target-Guided Open-Domain Conversation" in ACL 2019☆149Updated 5 years ago
- ☆120Updated 5 years ago
- PyTorch implementation of BERT in "BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding"☆94Updated 5 years ago
- pytorch implementation for Patient Knowledge Distillation for BERT Model Compression☆198Updated 5 years ago