Edy-Barraza / Transformer_DistillationLinks
Knowledge Distillation For Transformer Language Models
☆52Updated last year
Alternatives and similar repositories for Transformer_Distillation
Users that are interested in Transformer_Distillation are comparing it to the libraries listed below
Sorting:
- MAsked Sequence to Sequence (MASS) pre-training for language generation☆21Updated 6 years ago
- Distilling BERT using natural language generation.☆38Updated last year
- PyTorch implementation of Attention-over-Attention Neural Networks for Reading Comprehension☆60Updated 7 years ago
- Code for EMNLP 2018 paper https://arxiv.org/pdf/1808.09075.pdf☆38Updated 6 years ago
- ☆59Updated 5 years ago
- In this project we develop new deep learning models for bootstrapping language understanding models for languages with no labeled data us…☆78Updated 2 years ago
- Ordered Neurons LSTM☆30Updated 3 years ago
- This is the code in <Selection Bias Explorations and Debias Methods for Natural Language Sentence Matching Datasets> which has been accep…☆34Updated last year
- An Implementation of Bidirectional Attention Flow☆40Updated 7 years ago
- modification of official bert for downstream task☆31Updated 2 years ago
- Coupling Distant Annotation and Adversarial Training for Cross-Domain Chinese Word Segmentation☆22Updated 4 years ago
- ☆47Updated 4 years ago
- Efficient Contextualized Representation: Language Model Pruning for Sequence Labeling☆146Updated 5 years ago
- Knowledge Distillation from BERT☆52Updated 6 years ago
- This is the PyTorch implementation of the ACL 2019 paper RankQA: Neural Question Answering with Answer Re-Ranking.☆83Updated 3 years ago
- NoiseMix - data generation for natural language☆40Updated 7 years ago
- souce code for "Accelerating Neural Transformer via an Average Attention Network"☆78Updated 5 years ago
- ☆83Updated 5 years ago
- ☆29Updated 5 years ago
- Tensorflow 1.14 for Bert, Bert UniLM, ALBert☆35Updated 5 years ago
- Record papers for some NLP related area☆24Updated 3 years ago
- Implementation of Densely Connected Attention Propagation for Reading Comprehension (NIPS 2018)☆69Updated 6 years ago
- 高性能小模型测评 Shared Tasks in NLPCC 2020. Task 1 - Light Pre-Training Chinese Language Model for NLP Task☆58Updated 5 years ago
- ICLR2019, Multilingual Neural Machine Translation with Knowledge Distillation☆70Updated 4 years ago
- Code for ACL 2019 oral paper - Learning Compressed Sentence Representations for On-Device Text Processing.☆43Updated 4 years ago
- NAACL'19: "Jointly Optimizing Diversity and Relevance in Neural Response Generation"☆74Updated 4 years ago
- Repository for the IWCS 2017 paper "Representation Learning for Answer Selection with LSTM-Based Importance Weighting"☆26Updated 7 years ago
- Code for Synchronous Bidirectional Neural Machine Translation (SB-NMT)☆66Updated 6 years ago
- ☆50Updated last year
- PyTorch port of BERT ML model☆16Updated 6 years ago