ZhengZixiang / ATPapers
Worth-reading papers and related resources on attention mechanism, Transformer and pretrained language model (PLM) such as BERT. 值得一读的注意力机制、Transformer和预训练语言模型论文与相关资源集合
☆133Updated 3 years ago
Alternatives and similar repositories for ATPapers:
Users that are interested in ATPapers are comparing it to the libraries listed below
- ☆92Updated 4 years ago
- Paper Lists, Notes and Slides, Focus on NLP. For summarization, please refer to https://github.com/xcfcode/Summarization-Papers☆162Updated 2 years ago
- A PyTorch implementation of "Improving BERT Fine-Tuning via Self-Ensemble and Self-Distillation"☆56Updated 4 years ago
- ☆74Updated 2 years ago
- Code for the RecAdam paper: Recall and Learn: Fine-tuning Deep Pretrained Language Models with Less Forgetting.☆115Updated 4 years ago
- ☆96Updated 4 years ago
- Minghao Hu's thesis on Machine Reading Comprehension☆37Updated 5 years ago
- pytorch implementation for Patient Knowledge Distillation for BERT Model Compression☆200Updated 5 years ago
- ☆24Updated 4 years ago
- For the code release of our arXiv paper "Revisiting Few-sample BERT Fine-tuning" (https://arxiv.org/abs/2006.05987).☆184Updated last year
- Interpreting Bidirectional Encoder Representations from Transformers (BERT)☆109Updated 2 years ago
- UNF(Universal NLP Framework)☆70Updated 4 years ago
- EMNLP'19: Bridging the Gap between Relevance Matching and Semantic Matching for Short Text Similarity Modeling☆77Updated last year
- Semi-supervised Learning for Sentiment Analysis☆54Updated 4 years ago
- 24*2个预训练的小型BERT模型,NLPer炼丹利器☆51Updated 4 years ago
- Survey on Machine Reading Comprehension☆148Updated 4 years ago
- Pytorch implementation of Bert and Pals: Projected Attention Layers for Efficient Adaptation in Multi-Task Learning (https://arxiv.org/ab…☆82Updated 5 years ago
- A list of recent papers about Meta / few-shot learning methods applied in NLP areas.☆231Updated 4 years ago
- Adversarial Training for Natural Language Understanding☆252Updated last year
- Towards Scalable and Reliable Capsule Networks for Challenging NLP Applications☆120Updated 5 years ago
- ⛵️The official PyTorch implementation for "BERT-of-Theseus: Compressing BERT by Progressive Module Replacing" (EMNLP 2020).☆310Updated last year
- [ACL 2020] DeFormer: Decomposing Pre-trained Transformers for Faster Question Answering☆120Updated last year
- The code of Encoding Word Order in Complex-valued Embedding☆42Updated 5 years ago
- An attempt at replicating the Induction Network for FewRel data in Tensorflow☆177Updated 5 years ago
- Source code of paper "BP-Transformer: Modelling Long-Range Context via Binary Partitioning"☆126Updated 3 years ago
- ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators☆91Updated 3 years ago
- ☆47Updated 4 years ago
- a simple yet complete implementation of the popular BERT model☆126Updated 4 years ago
- Papers I have read, mainly about NLP. Welcome everyone to supplement in issue.☆256Updated 3 years ago
- 注意力机制on自然语言处理文章整理笔记☆170Updated 6 years ago