ZhengZixiang / ATPapersLinks
Worth-reading papers and related resources on attention mechanism, Transformer and pretrained language model (PLM) such as BERT. 值得一读的注意力机制、Transformer和预训练语言模型论文与相关资源集合
☆130Updated 4 years ago
Alternatives and similar repositories for ATPapers
Users that are interested in ATPapers are comparing it to the libraries listed below
Sorting:
- ☆94Updated 5 years ago
- Paper Lists, Notes and Slides, Focus on NLP. For summarization, please refer to https://github.com/xcfcode/Summarization-Papers☆165Updated 3 years ago
- a simple yet complete implementation of the popular BERT model☆128Updated 5 years ago
- A PyTorch implementation of "Improving BERT Fine-Tuning via Self-Ensemble and Self-Distillation"☆56Updated 5 years ago
- EMNLP'19: Bridging the Gap between Relevance Matching and Semantic Matching for Short Text Similarity Modeling☆78Updated 2 years ago
- For the code release of our arXiv paper "Revisiting Few-sample BERT Fine-tuning" (https://arxiv.org/abs/2006.05987).☆185Updated 2 years ago
- pytorch implementation for Patient Knowledge Distillation for BERT Model Compression☆203Updated 6 years ago
- ☆25Updated 5 years ago
- Code for the RecAdam paper: Recall and Learn: Fine-tuning Deep Pretrained Language Models with Less Forgetting.☆119Updated 5 years ago
- Distilling BERT using natural language generation.☆39Updated 2 years ago
- This is the official code repository for NumNet+(https://leaderboard.allenai.org/drop/submission/blu418v76glsbnh1qvd0)☆176Updated last year
- Semi-supervised Learning for Sentiment Analysis☆54Updated 5 years ago
- Repository for the paper "Fast and Accurate Deep Bidirectional Language Representations for Unsupervised Learning"☆110Updated 5 years ago
- ☆48Updated 4 years ago
- The code of Encoding Word Order in Complex-valued Embedding☆42Updated 6 years ago
- ☆75Updated 3 years ago
- ☆50Updated 2 years ago
- ☆84Updated 6 years ago
- [ACL 2020] DeFormer: Decomposing Pre-trained Transformers for Faster Question Answering☆121Updated 2 years ago
- Survey on Machine Reading Comprehension☆147Updated 4 years ago
- ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators☆91Updated 4 years ago
- A list of recent papers about Meta / few-shot learning methods applied in NLP areas.☆231Updated 5 years ago
- ⛵️The official PyTorch implementation for "BERT-of-Theseus: Compressing BERT by Progressive Module Replacing" (EMNLP 2020).☆315Updated 2 years ago
- Codes for our paper at EMNLP2019☆36Updated 6 years ago
- Source code of paper "BP-Transformer: Modelling Long-Range Context via Binary Partitioning"☆127Updated 4 years ago
- This is the PyTorch implementation of the ACL 2019 paper RankQA: Neural Question Answering with Answer Re-Ranking.☆83Updated 4 years ago
- 高性能小模型测评 Shared Tasks in NLPCC 2020. Task 1 - Light Pre-Training Chinese Language Model for NLP Task☆60Updated 5 years ago
- Interpreting Bidirectional Encoder Representations from Transformers (BERT)☆111Updated 3 years ago
- Transformer with Untied Positional Encoding (TUPE). Code of paper "Rethinking Positional Encoding in Language Pre-training". Improve exis…☆253Updated 4 years ago
- Graph Convolution Network for NLP☆211Updated 2 years ago