Edy-Barraza / Transformer_DistillationLinks
Knowledge Distillation For Transformer Language Models
☆52Updated last year
Alternatives and similar repositories for Transformer_Distillation
Users that are interested in Transformer_Distillation are comparing it to the libraries listed below
Sorting:
- Distilling BERT using natural language generation.☆38Updated 2 years ago
- a simple yet complete implementation of the popular BERT model☆128Updated 5 years ago
- MAsked Sequence to Sequence (MASS) pre-training for language generation☆21Updated 6 years ago
- Efficient Contextualized Representation: Language Model Pruning for Sequence Labeling☆147Updated 5 years ago
- This is the PyTorch implementation of the ACL 2019 paper RankQA: Neural Question Answering with Answer Re-Ranking.☆83Updated 3 years ago
- PyTorch implementation of Attention-over-Attention Neural Networks for Reading Comprehension☆59Updated 8 years ago
- NAACL'19: "Jointly Optimizing Diversity and Relevance in Neural Response Generation"☆73Updated 5 years ago
- ☆86Updated 5 years ago
- Code for Synchronous Bidirectional Neural Machine Translation (SB-NMT)☆66Updated 6 years ago
- Compare-Aggregate method for WikiQA (via PyTorch)☆28Updated 7 years ago
- Code for EMNLP 2018 paper https://arxiv.org/pdf/1808.09075.pdf☆38Updated 7 years ago
- Record papers for some NLP related area☆24Updated 3 years ago
- add BERT to encoder part for https://github.com/memray/seq2seq-keyphrase-pytorch☆80Updated 6 years ago
- CapsNet for NLP☆67Updated 6 years ago
- PyTorch port of BERT ML model☆17Updated 6 years ago
- Reproducing Character-Level-Language-Modeling with Deeper Self-Attention in PyTorch☆62Updated 6 years ago
- PyTorch implementation of Transformer-based Neural Machine Translation☆78Updated 2 years ago
- Multiple Different Natural Language Processing Tasks in a Single Deep Model☆48Updated 6 years ago
- An Implementation of Bidirectional Attention Flow☆40Updated 8 years ago
- modification of official bert for downstream task☆32Updated 2 years ago
- 高性能小模型测评 Shared Tasks in NLPCC 2020. Task 1 - Light Pre-Training Chinese Language Model for NLP Task☆60Updated 5 years ago
- This repo is code for the COLING 2018 paper: Sequence-to-sequence Data Augmentation for Dialogue Language Understanding.☆76Updated 4 years ago
- Fork of huggingface/pytorch-pretrained-BERT for BERT on STILTs☆106Updated 2 years ago
- XLNet for generating language.☆166Updated 4 years ago
- Position embedding layers in Keras☆58Updated 3 years ago
- souce code for "Accelerating Neural Transformer via an Average Attention Network"☆78Updated 6 years ago
- dstc7-noesis☆45Updated 6 years ago
- Natural Language Generation by Hierarchical Decoding with Linguistic Patterns (NAACL-HLT 2018), Investigating Linguistic Pattern Ordering…☆32Updated 7 years ago
- ☆47Updated 5 years ago
- ☆46Updated last year