Edy-Barraza / Transformer_Distillation
Knowledge Distillation For Transformer Language Models
☆52Updated last year
Alternatives and similar repositories for Transformer_Distillation:
Users that are interested in Transformer_Distillation are comparing it to the libraries listed below
- ☆59Updated 5 years ago
- Record papers for some NLP related area☆24Updated 3 years ago
- PyTorch port of BERT ML model☆16Updated 6 years ago
- Distilling BERT using natural language generation.☆37Updated last year
- An Implementation of Bidirectional Attention Flow☆40Updated 7 years ago
- modification of official bert for downstream task☆31Updated 2 years ago
- Ordered Neurons LSTM☆30Updated 3 years ago
- MAsked Sequence to Sequence (MASS) pre-training for language generation☆21Updated 6 years ago
- Code for EMNLP 2018 paper https://arxiv.org/pdf/1808.09075.pdf☆38Updated 6 years ago
- ☆47Updated 4 years ago
- Knowledge Distillation from BERT☆52Updated 6 years ago
- ☆46Updated 8 months ago
- PyTorch implementation of Attention-over-Attention Neural Networks for Reading Comprehension☆60Updated 7 years ago
- BERT Extension in TensorFlow☆30Updated 5 years ago
- Implementation of Densely Connected Attention Propagation for Reading Comprehension (NIPS 2018)☆69Updated 6 years ago
- 高性能小模型测评 Shared Tasks in NLPCC 2020. Task 1 - Light Pre-Training Chinese Language Model for NLP Task☆58Updated 4 years ago
- code for Question Condensing Networks for Answer Selection in Community Question Answering☆14Updated 6 years ago
- Implemented transformer NN block for Machine translation, text classfication, Natural language inference as well as Machine reading compr…☆11Updated 11 months ago
- R-Net with PyTorch☆24Updated 7 years ago
- Knowledge Graph based Question Answering benchmark.☆10Updated 5 years ago
- ☆29Updated 5 years ago
- ☆47Updated 4 years ago
- Tensorflow 1.14 for Bert, Bert UniLM, ALBert☆35Updated 5 years ago
- Codes for our paper at EMNLP2019☆36Updated 5 years ago
- ☆23Updated 2 years ago
- ICLR2019, Multilingual Neural Machine Translation with Knowledge Distillation☆70Updated 4 years ago
- This is the PyTorch implementation of the ACL 2019 paper RankQA: Neural Question Answering with Answer Re-Ranking.☆83Updated 3 years ago
- ☆83Updated 5 years ago
- Deep Unknown Intent Detection with Margin Loss (ACL2019)☆34Updated 2 years ago
- Multitask Learning for Machine Reading Comprehension, NAACL 2019☆100Updated 4 years ago