Alternatives and similar repositories for KnowledgeDistillation

Users that are interested in KnowledgeDistillation are comparing it to the libraries listed below

• intersun / PKD-for-BERT-Model-Compression
  pytorch implementation for Patient Knowledge Distillation for BERT Model Compression
  ☆201Updated 5 years ago
• cdj0311 / bert_distill_lstm
  Distilling Task-Specific Knowledge from BERT into Simple Neural Networks.
  ☆13Updated 4 years ago
• choosewhatulike / sparse-sharing
  Codes for "Learning Sparse Sharing Architectures for Multiple Tasks"
  ☆95Updated 4 years ago
• kevinmtian / distill-bert
  Knowledge Distillation from BERT
  ☆52Updated 6 years ago
• rogerrojur / tianchi-multi-task-nlp
  NLP中文预训练模型泛化能力挑战赛
  ☆42Updated 4 years ago
• bojone / keras_adversarial_training
  Adversarial Training for NLP in Keras
  ☆46Updated 5 years ago
• bojone / r-drop
  R-Drop方法在中文任务上的简单实验
  ☆91Updated 3 years ago
• lonePatient / BERT-SDA
  A PyTorch implementation of "Improving BERT Fine-Tuning via Self-Ensemble and Self-Distillation"
  ☆56Updated 5 years ago
• HoyTta0 / KnowledgeDistillation
  Knowledge distillation in text classification with pytorch. 知识蒸馏，中文文本分类，教师模型BERT、XLNET，学生模型biLSTM。
  ☆223Updated 2 years ago
• bzantium / pytorch-PKD-for-BERT-compression
  ☆15Updated 5 years ago
• beyondguo / label_confusion_learning
  Official implementation of AAAI-21 paper "Label Confusion Learning to Enhance Text Classification Models"
  ☆115Updated 2 years ago
• qiangsiwei / bert_distill
  BERT distillation（基于BERT的蒸馏实验 ）
  ☆313Updated 4 years ago
• wangbq18 / distillation_model_keras_bert
  CNN、BiLSTM、Bert(3layers)对Bert(12layers)模型的蒸馏的keras实现
  ☆28Updated 5 years ago
• lonePatient / multi-sample_dropout_pytorch
  a simple pytorch implement of Multi-Sample Dropout
  ☆57Updated 5 years ago
• BetterBench / 2021-Daguan-Cup
  ☆40Updated 3 years ago
• BitVoyage / FastBERT
  对ACL2020 FastBERT论文的复现，论文地址//arxiv.org/pdf/2004.02178.pdf
  ☆194Updated 3 years ago
• yongbowin / pytorch-pretrained-BERT_annotation
  bert annotation, input and output for people from scratch, 代码注释, 有每一步的输入和输出, 适合初学者
  ☆93Updated 2 years ago
• lonePatient / MobileBert_PyTorch
  MobileBERT: a Compact Task-Agnostic BERT for Resource-Limited Devices
  ☆67Updated 5 years ago
• zzysay / KD4NRE
  Example code for paper "Distilling Knowledge from Well-informed Soft Labels for Neural Relation Extraction" (AAAI 2020).
  ☆22Updated 5 years ago
• qiufengyuyi / bert-of-theseus-tf
  tensorflow version of bert-of-theseus
  ☆62Updated 4 years ago
• RAvontuur / hierarchical-multilabel-classification
  ☆33Updated 5 years ago
• BlackHorseQ / Use-transformers-train-Bert-from-scratch
  TIANCHI-小布助手对话短文本语义匹配BERT baseline
  ☆32Updated 4 years ago
• HuipengXu / tianchi-multi-task
  NLP中文预训练模型泛化能力挑战赛(https://tianchi.aliyun.com/competition/entrance/531841/introduction?spm=5176.12281957.1004.2.7a883eafYhYhOq)
  ☆36Updated 4 years ago
• chizhu / tianchi-gaic-track3-share
  天池人工智能创新赛3-ch12hu团队周星星分享
  ☆26Updated 4 years ago
• luxuantao / huawei_nezha_practice
  华为哪吒模型实践指南
  ☆21Updated 3 years ago
• daniellibin / nCoV-2019-sentence-similarity
  天池-新冠疫情相似句对判定大赛 Rank8
  ☆52Updated 5 years ago
• AtmaHou / FewShotMultiLabel
  Code for AAAI2021 paper: Few-Shot Learning for Multi-label Intent Detection.
  ☆107Updated 3 years ago
• Christmas-Wong / paper_project
  论文模型复现
  ☆42Updated 2 years ago
• sfzhou5678 / PretrainedLittleBERTs
  24*2个预训练的小型BERT模型，NLPer炼丹利器
  ☆50Updated 5 years ago
• bojone / bert-of-theseus
  bert-of-theseus via bert4keras
  ☆31Updated 4 years ago