Edy-Barraza / Transformer_DistillationLinks
Knowledge Distillation For Transformer Language Models
☆52Updated last year
Alternatives and similar repositories for Transformer_Distillation
Users that are interested in Transformer_Distillation are comparing it to the libraries listed below
Sorting:
- Distilling BERT using natural language generation.☆38Updated 2 years ago
- This is the PyTorch implementation of the ACL 2019 paper RankQA: Neural Question Answering with Answer Re-Ranking.☆83Updated 3 years ago
- a simple yet complete implementation of the popular BERT model☆128Updated 5 years ago
- ICLR2019, Multilingual Neural Machine Translation with Knowledge Distillation☆70Updated 4 years ago
- PyTorch implementation of Attention-over-Attention Neural Networks for Reading Comprehension☆59Updated 8 years ago
- modification of official bert for downstream task☆32Updated 2 years ago
- MAsked Sequence to Sequence (MASS) pre-training for language generation☆21Updated 6 years ago
- Efficient Contextualized Representation: Language Model Pruning for Sequence Labeling☆147Updated 5 years ago
- Implementation of Densely Connected Attention Propagation for Reading Comprehension (NIPS 2018)☆69Updated 6 years ago
- This repo is code for the COLING 2018 paper: Sequence-to-sequence Data Augmentation for Dialogue Language Understanding.☆76Updated 3 years ago
- NAACL'19: "Jointly Optimizing Diversity and Relevance in Neural Response Generation"☆73Updated 4 years ago
- ☆46Updated last year
- souce code for "Accelerating Neural Transformer via an Average Attention Network"☆78Updated 6 years ago
- A parser of the Multi-Domain Wizard-of-Oz dataset (MultiWOZ)☆67Updated 6 years ago
- 高性能小模型测评 Shared Tasks in NLPCC 2020. Task 1 - Light Pre-Training Chinese Language Model for NLP Task☆60Updated 5 years ago
- dstc7-noesis☆45Updated 6 years ago
- Code for reproducing the results from the paper Few Shot Text Classification with a Human in the Loop☆90Updated 7 years ago
- add BERT to encoder part for https://github.com/memray/seq2seq-keyphrase-pytorch☆80Updated 6 years ago
- Code for EMNLP 2018 paper https://arxiv.org/pdf/1808.09075.pdf☆38Updated 7 years ago
- Multiple Different Natural Language Processing Tasks in a Single Deep Model☆48Updated 6 years ago
- PyTorch implementation of Transformer-based Neural Machine Translation☆78Updated 2 years ago
- code for Question Condensing Networks for Answer Selection in Community Question Answering☆14Updated 7 years ago
- Record papers for some NLP related area☆24Updated 3 years ago
- Natural Language Generation by Hierarchical Decoding with Linguistic Patterns (NAACL-HLT 2018), Investigating Linguistic Pattern Ordering…☆32Updated 6 years ago
- Deep Unknown Intent Detection with Margin Loss (ACL2019)☆35Updated 2 years ago
- ☆53Updated 4 years ago
- List some datasets in NLP field.☆29Updated 4 years ago
- ☆86Updated 5 years ago
- Reproducing Character-Level-Language-Modeling with Deeper Self-Attention in PyTorch☆61Updated 6 years ago
- Ordered Neurons LSTM☆30Updated 3 years ago