Edy-Barraza / Transformer_DistillationLinks
Knowledge Distillation For Transformer Language Models
☆52Updated last year
Alternatives and similar repositories for Transformer_Distillation
Users that are interested in Transformer_Distillation are comparing it to the libraries listed below
Sorting:
- Distilling BERT using natural language generation.☆38Updated 2 years ago
- a simple yet complete implementation of the popular BERT model☆128Updated 5 years ago
- ☆86Updated 5 years ago
- This is the PyTorch implementation of the ACL 2019 paper RankQA: Neural Question Answering with Answer Re-Ranking.☆83Updated 3 years ago
- MAsked Sequence to Sequence (MASS) pre-training for language generation☆21Updated 6 years ago
- modification of official bert for downstream task☆32Updated 2 years ago
- PyTorch implementation of Attention-over-Attention Neural Networks for Reading Comprehension☆59Updated 7 years ago
- PyTorch port of BERT ML model☆17Updated 6 years ago
- LAMB Optimizer for Large Batch Training (TensorFlow version)☆120Updated 5 years ago
- Compare-Aggregate method for WikiQA (via PyTorch)☆28Updated 7 years ago
- Efficient Contextualized Representation: Language Model Pruning for Sequence Labeling☆147Updated 5 years ago
- Code for EMNLP 2018 paper https://arxiv.org/pdf/1808.09075.pdf☆38Updated 7 years ago
- CapsNet for NLP☆67Updated 6 years ago
- ICLR2019, Multilingual Neural Machine Translation with Knowledge Distillation☆70Updated 4 years ago
- ☆47Updated 4 years ago
- Reproducing Character-Level-Language-Modeling with Deeper Self-Attention in PyTorch☆61Updated 6 years ago
- NAACL'19: "Jointly Optimizing Diversity and Relevance in Neural Response Generation"☆74Updated 4 years ago
- Ordered Neurons LSTM☆30Updated 3 years ago
- Fork of huggingface/pytorch-pretrained-BERT for BERT on STILTs☆106Updated 2 years ago
- Natural Language Generation by Hierarchical Decoding with Linguistic Patterns (NAACL-HLT 2018), Investigating Linguistic Pattern Ordering…☆32Updated 6 years ago
- ☆61Updated 5 years ago
- A large-scale cleaned Chinese chitchat corpus and Chinese dialogpt models☆35Updated 5 years ago
- souce code for "Accelerating Neural Transformer via an Average Attention Network"☆78Updated 6 years ago
- In this project we develop new deep learning models for bootstrapping language understanding models for languages with no labeled data us…☆78Updated 3 years ago
- Multiple Different Natural Language Processing Tasks in a Single Deep Model☆48Updated 6 years ago
- BERT for joint intent classification and slot filling☆39Updated 5 years ago
- PyTorch implementation of Transformer-based Neural Machine Translation☆78Updated 2 years ago
- This repo is code for the COLING 2018 paper: Sequence-to-sequence Data Augmentation for Dialogue Language Understanding.☆76Updated 3 years ago
- code for Question Condensing Networks for Answer Selection in Community Question Answering☆14Updated 7 years ago
- Record papers for some NLP related area☆24Updated 3 years ago