Alternatives and similar repositories for Transformer_Distillation

Users that are interested in Transformer_Distillation are comparing it to the libraries listed below

• jcyk / BERT
  a simple yet complete implementation of the popular BERT model
  ☆128Updated 5 years ago
• ishwnews / MASS
  MAsked Sequence to Sequence (MASS) pre-training for language generation
  ☆21Updated 6 years ago
• golsun / SpaceFusion
  NAACL'19: "Jointly Optimizing Diversity and Relevance in Neural Response Generation"
  ☆73Updated 5 years ago
• kevinkwl / AoAReader
  PyTorch implementation of Attention-over-Attention Neural Networks for Reading Comprehension
  ☆59Updated 8 years ago
• bernhard2202 / rankqa
  This is the PyTorch implementation of the ACL 2019 paper RankQA: Neural Question Answering with Answer Re-Ranking.
  ☆83Updated 3 years ago
• yyht / BERT
  modification of official bert for downstream task
  ☆32Updated 2 years ago
• allenai / allennlp-bert-qa-wrapper
  ☆47Updated 5 years ago
• allenai / allennlp-reading-comprehension
  ☆86Updated 5 years ago
• MiuLab / HNLG
  Natural Language Generation by Hierarchical Decoding with Linguistic Patterns (NAACL-HLT 2018), Investigating Linguistic Pattern Ordering…
  ☆32Updated 7 years ago
• castorini / d-bert
  Distilling BERT using natural language generation.
  ☆38Updated 2 years ago
• CLUEbenchmark / LightLM
  高性能小模型测评 Shared Tasks in NLPCC 2020. Task 1 - Light Pre-Training Chinese Language Model for NLP Task
  ☆60Updated 5 years ago
• RayeRen / multilingual-kd-pytorch
  ICLR2019, Multilingual Neural Machine Translation with Knowledge Distillation
  ☆70Updated 5 years ago
• minghao-wu / CRF-AE
  Code for EMNLP 2018 paper https://arxiv.org/pdf/1808.09075.pdf
  ☆38Updated 7 years ago
• ictnlp / RSI-NAT
  Source code for "Retrieving Sequential Information for Non-Autoregressive Neural Machine Translation"
  ☆18Updated 6 years ago
• IBM / dstc-noesis
  dstc7-noesis
  ☆45Updated 6 years ago
• hankcs / sub-character-cws
  Sub-Character Representation Learning
  ☆25Updated 7 years ago
• microsoft / Multilingual-Model-Transfer
  In this project we develop new deep learning models for bootstrapping language understanding models for languages with no labeled data us…
  ☆78Updated 3 years ago
• LiyuanLucasLiu / LD-Net
  Efficient Contextualized Representation: Language Model Pruning for Sequence Labeling
  ☆147Updated 5 years ago
• zphang / bert_on_stilts
  Fork of huggingface/pytorch-pretrained-BERT for BERT on STILTs
  ☆106Updated 3 years ago
• bzhangGo / transformer-aan
  souce code for "Accelerating Neural Transformer via an Average Attention Network"
  ☆78Updated 6 years ago
• pku-wuwei / QCN
  code for Question Condensing Networks for Answer Selection in Community Question Answering
  ☆14Updated 7 years ago
• shuohangwang / Cross-Thought
  ☆48Updated 4 years ago
• saurabhkulkarni77 / DistillBERT
  ☆61Updated 6 years ago
• katbailey / few-shot-text-classification
  Code for reproducing the results from the paper Few Shot Text Classification with a Human in the Loop
  ☆90Updated 7 years ago
• jasonwbw / RecordPapers4NLP
  Record papers for some NLP related area
  ☆24Updated 3 years ago
• JasonForJoy / SA-BERT
  CIKM 2020: Speaker-Aware BERT for Multi-Turn Response Selection in Retrieval-Based Chatbots
  ☆74Updated 5 years ago
• AtmaHou / Seq2SeqDataAugmentationForLU
  This repo is code for the COLING 2018 paper: Sequence-to-sequence Data Augmentation for Dialogue Language Understanding.
  ☆76Updated 4 years ago
• ymcui / LAMB_Optimizer_TF
  LAMB Optimizer for Large Batch Training (TensorFlow version)
  ☆121Updated 5 years ago
• jojonki / MultiWOZ-Parser
  A parser of the Multi-Domain Wizard-of-Oz dataset (MultiWOZ)
  ☆68Updated 7 years ago
• burglarhobbit / machine-reading-comprehension
  ☆23Updated 2 years ago