Edy-Barraza / Transformer_DistillationLinks
Knowledge Distillation For Transformer Language Models
☆52Updated last year
Alternatives and similar repositories for Transformer_Distillation
Users that are interested in Transformer_Distillation are comparing it to the libraries listed below
Sorting:
- MAsked Sequence to Sequence (MASS) pre-training for language generation☆21Updated 6 years ago
- Distilling BERT using natural language generation.☆38Updated last year
- PyTorch port of BERT ML model☆16Updated 6 years ago
- Compare-Aggregate method for WikiQA (via PyTorch)☆28Updated 7 years ago
- Code for EMNLP 2018 paper https://arxiv.org/pdf/1808.09075.pdf☆38Updated 6 years ago
- Reproducing Character-Level-Language-Modeling with Deeper Self-Attention in PyTorch☆61Updated 6 years ago
- PyTorch implementation of Attention-over-Attention Neural Networks for Reading Comprehension☆60Updated 7 years ago
- ☆46Updated 10 months ago
- Record papers for some NLP related area☆24Updated 3 years ago
- CapsNet for NLP☆67Updated 6 years ago
- modification of official bert for downstream task☆31Updated 2 years ago
- NAACL'19: "Jointly Optimizing Diversity and Relevance in Neural Response Generation"☆74Updated 4 years ago
- Ordered Neurons LSTM☆30Updated 3 years ago
- ☆33Updated 6 years ago
- Natural Language Generation by Hierarchical Decoding with Linguistic Patterns (NAACL-HLT 2018), Investigating Linguistic Pattern Ordering…☆32Updated 6 years ago
- Universal segmenter based on the Universal Dependency framework, written by Y. Shao, Uppsala University☆34Updated 6 years ago
- ICLR2019, Multilingual Neural Machine Translation with Knowledge Distillation☆70Updated 4 years ago
- ☆47Updated 4 years ago
- code for Question Condensing Networks for Answer Selection in Community Question Answering☆14Updated 6 years ago
- a Pytorch implementation of the Reformer Network (https://openreview.net/pdf?id=rkgNKkHtvB)☆53Updated 2 years ago
- ☆85Updated 5 years ago
- DREAM: A Challenge Dataset and Models for Dialogue-Based Reading Comprehension☆77Updated 6 years ago
- Repository for the IWCS 2017 paper "Representation Learning for Answer Selection with LSTM-Based Importance Weighting"☆26Updated 7 years ago
- This is the code in <Selection Bias Explorations and Debias Methods for Natural Language Sentence Matching Datasets> which has been accep…☆34Updated 2 years ago
- dstc7-noesis☆46Updated 5 years ago
- Efficient Contextualized Representation: Language Model Pruning for Sequence Labeling☆146Updated 5 years ago
- In this project we develop new deep learning models for bootstrapping language understanding models for languages with no labeled data us…☆78Updated 2 years ago
- Code for Synchronous Bidirectional Neural Machine Translation (SB-NMT)☆66Updated 6 years ago
- souce code for "Accelerating Neural Transformer via an Average Attention Network"☆78Updated 6 years ago
- An Implementation of Bidirectional Attention Flow☆40Updated 7 years ago