Edy-Barraza / Transformer_DistillationLinks
Knowledge Distillation For Transformer Language Models
☆54Updated 2 years ago
Alternatives and similar repositories for Transformer_Distillation
Users that are interested in Transformer_Distillation are comparing it to the libraries listed below
Sorting:
- Distilling BERT using natural language generation.☆39Updated 2 years ago
- MAsked Sequence to Sequence (MASS) pre-training for language generation☆20Updated 6 years ago
- Code for EMNLP 2018 paper https://arxiv.org/pdf/1808.09075.pdf☆38Updated 7 years ago
- PyTorch port of BERT ML model☆17Updated 6 years ago
- a simple yet complete implementation of the popular BERT model☆128Updated 5 years ago
- NAACL'19: "Jointly Optimizing Diversity and Relevance in Neural Response Generation"☆73Updated 5 years ago
- This is the PyTorch implementation of the ACL 2019 paper RankQA: Neural Question Answering with Answer Re-Ranking.☆83Updated 4 years ago
- PyTorch implementation of Attention-over-Attention Neural Networks for Reading Comprehension☆59Updated 8 years ago
- ☆86Updated 5 years ago
- ICLR2019, Multilingual Neural Machine Translation with Knowledge Distillation☆70Updated 5 years ago
- LAMB Optimizer for Large Batch Training (TensorFlow version)☆121Updated 6 years ago
- dstc7-noesis☆45Updated 6 years ago
- Fork of huggingface/pytorch-pretrained-BERT for BERT on STILTs☆106Updated 3 years ago
- Natural Language Generation by Hierarchical Decoding with Linguistic Patterns (NAACL-HLT 2018), Investigating Linguistic Pattern Ordering…☆32Updated 7 years ago
- A parser of the Multi-Domain Wizard-of-Oz dataset (MultiWOZ)☆68Updated 7 years ago
- Tensorflow 1.14 for Bert, Bert UniLM, ALBert☆35Updated 6 years ago
- ☆53Updated 5 years ago
- BERT for joint intent classification and slot filling☆39Updated 6 years ago
- Record papers for some NLP related area☆24Updated 3 years ago
- a Pytorch implementation of the Reformer Network (https://openreview.net/pdf?id=rkgNKkHtvB)☆53Updated 3 years ago
- add BERT to encoder part for https://github.com/memray/seq2seq-keyphrase-pytorch☆80Updated 7 years ago
- ☆47Updated 5 years ago
- Code for reproducing the results from the paper Few Shot Text Classification with a Human in the Loop☆90Updated 7 years ago
- Multiple Different Natural Language Processing Tasks in a Single Deep Model☆48Updated 7 years ago
- XLNet for generating language.☆166Updated 5 years ago
- CapsNet for NLP☆66Updated 7 years ago
- DREAM: A Challenge Dataset and Models for Dialogue-Based Reading Comprehension☆78Updated 6 years ago
- ☆13Updated 9 years ago
- Language Model Pruning for Sequence Labeling☆147Updated 5 years ago
- A large-scale cleaned Chinese chitchat corpus and Chinese dialogpt models☆35Updated 5 years ago