Alternatives and similar repositories for KnowledgeDistillation

Users that are interested in KnowledgeDistillation are comparing it to the libraries listed below

• bojone / keras_adversarial_training
  Adversarial Training for NLP in Keras
  ☆46Updated 5 years ago
• intersun / PKD-for-BERT-Model-Compression
  pytorch implementation for Patient Knowledge Distillation for BERT Model Compression
  ☆203Updated 6 years ago
• cdj0311 / bert_distill_lstm
  Distilling Task-Specific Knowledge from BERT into Simple Neural Networks.
  ☆15Updated 5 years ago
• beyondguo / label_confusion_learning
  Official implementation of AAAI-21 paper "Label Confusion Learning to Enhance Text Classification Models"
  ☆119Updated 3 years ago
• HoyTta0 / KnowledgeDistillation
  Knowledge distillation in text classification with pytorch. 知识蒸馏，中文文本分类，教师模型BERT、XLNET，学生模型biLSTM。
  ☆229Updated 3 years ago
• bojone / r-drop
  R-Drop方法在中文任务上的简单实验
  ☆91Updated 3 years ago
• lonePatient / BERT-SDA
  A PyTorch implementation of "Improving BERT Fine-Tuning via Self-Ensemble and Self-Distillation"
  ☆56Updated 5 years ago
• qiangsiwei / bert_distill
  BERT distillation（基于BERT的蒸馏实验 ）
  ☆314Updated 5 years ago
• BetterBench / 2021-Daguan-Cup
  ☆41Updated 4 years ago
• kevinmtian / distill-bert
  Knowledge Distillation from BERT
  ☆54Updated 7 years ago
• lonePatient / multi-sample_dropout_pytorch
  a simple pytorch implement of Multi-Sample Dropout
  ☆57Updated 6 years ago
• BitVoyage / FastBERT
  对ACL2020 FastBERT论文的复现，论文地址//arxiv.org/pdf/2004.02178.pdf
  ☆193Updated 4 years ago
• chizhu / tianchi-gaic-track3-share
  天池人工智能创新赛3-ch12hu团队周星星分享
  ☆27Updated 4 years ago
• circlePi / Pretraining-Yourself-Bert-From-Scratch
  从头训练MASK BERT
  ☆139Updated 3 years ago
• jiangxinyang227 / few_shot_learning
  classical model code implementation of few-shot/one-shot lenaring, including siamese network, prototypical network, relation network, ind…
  ☆139Updated 6 years ago
• Lisennlp / TinyBert
  简洁易用版TinyBert：基于Bert进行知识蒸馏的预训练语言模型
  ☆269Updated 5 years ago
• AtmaHou / FewShotMultiLabel
  Code for AAAI2021 paper: Few-Shot Learning for Multi-label Intent Detection.
  ☆109Updated 3 years ago
• rogerrojur / tianchi-multi-task-nlp
  NLP中文预训练模型泛化能力挑战赛
  ☆42Updated 5 years ago
• WangJiuniu / adversarial_training
  Pytorch implementation of the methods proposed in **Adversarial Training Methods for Semi-Supervised Text Classification** on IMDB datase…
  ☆44Updated 6 years ago
• lonePatient / TorchBlocks
  A PyTorch-based toolkit for natural language processing
  ☆160Updated 2 years ago
• Decem-Y / sohu_text_matching_Rank2
  2021搜狐校园文本匹配算法大赛Top2方案
  ☆37Updated last year
• choosewhatulike / sparse-sharing
  Codes for "Learning Sparse Sharing Architectures for Multiple Tasks"
  ☆95Updated 5 years ago
• bzantium / pytorch-PKD-for-BERT-compression
  ☆15Updated 6 years ago
• wakafengfan / simcse-pytorch
  pytorch版simcse无监督语义相似模型
  ☆23Updated 4 years ago
• thuwyh / InferLight
  lightweighted deep learning inference service framework
  ☆39Updated 4 years ago
• BlackHorseQ / Use-transformers-train-Bert-from-scratch
  TIANCHI-小布助手对话短文本语义匹配BERT baseline
  ☆31Updated 4 years ago
• geyingli / unif
  基于 Tensorflow，仿 Scikit-Learn 设计的深度学习自然语言处理框架。支持 40 余种模型类，涵盖语言模型、文本分类、NER、MRC、知识蒸馏等各个领域
  ☆117Updated 2 years ago
• sfzhou5678 / PretrainedLittleBERTs
  24*2个预训练的小型BERT模型，NLPer炼丹利器
  ☆51Updated 5 years ago
• jerrylsu / JDMDC2020-Solution-2nd
  2020智源-京东多模态对话挑战大赛第二名方案
  ☆35Updated 3 years ago
• SanghunYun / UDA_pytorch
  UDA(Unsupervised Data Augmentation) implemented by pytorch
  ☆278Updated 6 years ago