Edy-Barraza / Transformer_DistillationLinks
Knowledge Distillation For Transformer Language Models
☆53Updated last year
Alternatives and similar repositories for Transformer_Distillation
Users that are interested in Transformer_Distillation are comparing it to the libraries listed below
Sorting:
- Distilling BERT using natural language generation.☆39Updated 2 years ago
- Reproducing Character-Level-Language-Modeling with Deeper Self-Attention in PyTorch☆62Updated 6 years ago
- a simple yet complete implementation of the popular BERT model☆128Updated 5 years ago
- ICLR2019, Multilingual Neural Machine Translation with Knowledge Distillation☆70Updated 5 years ago
- This is the PyTorch implementation of the ACL 2019 paper RankQA: Neural Question Answering with Answer Re-Ranking.☆83Updated 4 years ago
- Record papers for some NLP related area☆24Updated 3 years ago
- MAsked Sequence to Sequence (MASS) pre-training for language generation☆21Updated 6 years ago
- XLNet for generating language.☆166Updated 4 years ago
- Efficient Contextualized Representation: Language Model Pruning for Sequence Labeling☆147Updated 5 years ago
- modification of official bert for downstream task☆32Updated 2 years ago
- PyTorch port of BERT ML model☆17Updated 6 years ago
- Fork of huggingface/pytorch-pretrained-BERT for BERT on STILTs☆106Updated 3 years ago
- ☆86Updated 5 years ago
- NAACL'19: "Jointly Optimizing Diversity and Relevance in Neural Response Generation"☆73Updated 5 years ago
- PyTorch implementation of Attention-over-Attention Neural Networks for Reading Comprehension☆59Updated 8 years ago
- Natural Language Generation by Hierarchical Decoding with Linguistic Patterns (NAACL-HLT 2018), Investigating Linguistic Pattern Ordering…☆32Updated 7 years ago
- Code for EMNLP 2018 paper https://arxiv.org/pdf/1808.09075.pdf☆38Updated 7 years ago
- ☆47Updated last year
- Multiple Different Natural Language Processing Tasks in a Single Deep Model☆48Updated 7 years ago
- a Pytorch implementation of the Reformer Network (https://openreview.net/pdf?id=rkgNKkHtvB)☆53Updated 3 years ago
- Code for reproducing the results from the paper Few Shot Text Classification with a Human in the Loop☆90Updated 7 years ago
- CapsNet for NLP☆66Updated 6 years ago
- Sub-Character Representation Learning☆25Updated 7 years ago
- code for Question Condensing Networks for Answer Selection in Community Question Answering☆14Updated 7 years ago
- dstc7-noesis☆45Updated 6 years ago
- ☆47Updated 6 years ago
- Code for Synchronous Bidirectional Neural Machine Translation (SB-NMT)☆66Updated 6 years ago
- PyTorch implementation of Transformer-based Neural Machine Translation☆78Updated 2 years ago
- ☆22Updated 2 years ago
- Source code for "Retrieving Sequential Information for Non-Autoregressive Neural Machine Translation"☆18Updated 6 years ago