Alternatives and similar repositories for Transformer_Distillation

Users that are interested in Transformer_Distillation are comparing it to the libraries listed below

• jcyk / BERT
  a simple yet complete implementation of the popular BERT model
  ☆128Updated 5 years ago
• kevinkwl / AoAReader
  PyTorch implementation of Attention-over-Attention Neural Networks for Reading Comprehension
  ☆59Updated 8 years ago
• bernhard2202 / rankqa
  This is the PyTorch implementation of the ACL 2019 paper RankQA: Neural Question Answering with Answer Re-Ranking.
  ☆83Updated 3 years ago
• MiuLab / HNLG
  Natural Language Generation by Hierarchical Decoding with Linguistic Patterns (NAACL-HLT 2018), Investigating Linguistic Pattern Ordering…
  ☆32Updated 7 years ago
• LiyuanLucasLiu / LD-Net
  Efficient Contextualized Representation: Language Model Pruning for Sequence Labeling
  ☆147Updated 5 years ago
• minghao-wu / CRF-AE
  Code for EMNLP 2018 paper https://arxiv.org/pdf/1808.09075.pdf
  ☆38Updated 7 years ago
• castorini / d-bert
  Distilling BERT using natural language generation.
  ☆38Updated 2 years ago
• bzhangGo / transformer-aan
  souce code for "Accelerating Neural Transformer via an Average Attention Network"
  ☆78Updated 6 years ago
• ishwnews / MASS
  MAsked Sequence to Sequence (MASS) pre-training for language generation
  ☆21Updated 6 years ago
• IBM / dstc-noesis
  dstc7-noesis
  ☆45Updated 6 years ago
• RayeRen / multilingual-kd-pytorch
  ICLR2019, Multilingual Neural Machine Translation with Knowledge Distillation
  ☆70Updated 5 years ago
• yyht / BERT
  modification of official bert for downstream task
  ☆32Updated 2 years ago
• MultiPath / Squirrel
  PyTorch implementation of Transformer-based Neural Machine Translation
  ☆78Updated 2 years ago
• innodatalabs / tbert
  PyTorch port of BERT ML model
  ☆17Updated 6 years ago
• rusiaaman / XLnet-gen
  XLNet for generating language.
  ☆166Updated 4 years ago
• zphang / bert_on_stilts
  Fork of huggingface/pytorch-pretrained-BERT for BERT on STILTs
  ☆106Updated 2 years ago
• allenai / allennlp-bert-qa-wrapper
  ☆47Updated 5 years ago
• nadavbh12 / Character-Level-Language-Modeling-with-Deeper-Self-Attention-pytorch
  Reproducing Character-Level-Language-Modeling with Deeper Self-Attention in PyTorch
  ☆61Updated 6 years ago
• stefan-it / capsnet-nlp
  CapsNet for NLP
  ☆67Updated 6 years ago
• golsun / SpaceFusion
  NAACL'19: "Jointly Optimizing Diversity and Relevance in Neural Response Generation"
  ☆73Updated 5 years ago
• katbailey / few-shot-text-classification
  Code for reproducing the results from the paper Few Shot Text Classification with a Human in the Loop
  ☆90Updated 7 years ago
• kelayamatoz / BiDAF-PyTorch
  An Implementation of Bidirectional Attention Flow
  ☆40Updated 8 years ago
• getao / human-performance-gec
  ☆34Updated 7 years ago
• rubythonode / joint-many-task-model
  Multiple Different Natural Language Processing Tasks in a Single Deep Model
  ☆48Updated 6 years ago
• vanzytay / NIPS2018_DECAPROP
  Implementation of Densely Connected Attention Propagation for Reading Comprehension (NIPS 2018)
  ☆69Updated 6 years ago
• whqwill / seq2seq-keyphrase-bert
  add BERT to encoder part for https://github.com/memray/seq2seq-keyphrase-pytorch
  ☆80Updated 6 years ago
• pcgreat / SeqMatchSeq
  Compare-Aggregate method for WikiQA (via PyTorch)
  ☆28Updated 7 years ago
• zbloss / reformer_lm
  a Pytorch implementation of the Reformer Network (https://openreview.net/pdf?id=rkgNKkHtvB)
  ☆53Updated 2 years ago
• benkrause / dynamiceval-transformer
  ☆47Updated 6 years ago
• ictnlp / RSI-NAT
  Source code for "Retrieving Sequential Information for Non-Autoregressive Neural Machine Translation"
  ☆18Updated 6 years ago