Alternatives and similar repositories for knowledge-distillation:

Users that are interested in knowledge-distillation are comparing it to the libraries listed below

• jasonwei20 / triplet-loss
  ☆42Updated 4 years ago
• thunlp / ConversationQueryRewriter
  Code and Data for SIGIR 2020 Paper "Few-Shot Generative Conversational Query Rewriting"
  ☆65Updated last year
• lonePatient / BERT-SDA
  A PyTorch implementation of "Improving BERT Fine-Tuning via Self-Ensemble and Self-Distillation"
  ☆56Updated 5 years ago
• ChenRocks / Distill-BERT-Textgen
  Research code for ACL 2020 paper: "Distilling Knowledge Learned in BERT for Text Generation".
  ☆131Updated 3 years ago
• kevinmtian / distill-bert
  Knowledge Distillation from BERT
  ☆52Updated 6 years ago
• varunkumar-dev / TransformersDataAugmentation
  Code associated with the "Data Augmentation using Pre-trained Transformer Models" paper
  ☆135Updated last year
• neulab / SpanNER
  SpanNER: Named EntityRe-/Recognition as Span Prediction
  ☆126Updated 2 years ago
• intersun / PKD-for-BERT-Model-Compression
  pytorch implementation for Patient Knowledge Distillation for BERT Model Compression
  ☆201Updated 5 years ago
• JasonForJoy / SA-BERT
  CIKM 2020: Speaker-Aware BERT for Multi-Turn Response Selection in Retrieval-Based Chatbots
  ☆74Updated 4 years ago
• 1024er / cbert_aug
  ☆66Updated 2 years ago
• mawentao277 / CharBERT
  CharBERT: Character-aware Pre-trained Language Model (COLING2020)
  ☆120Updated 4 years ago
• taesunwhang / BERT-ResSel
  PyTorch Implementation for INTERSPEECH'20 "An Effective Domain Adaptive Post-Training Method for BERT in Response Selection"
  ☆31Updated 4 years ago
• SLAD-ml / few-shot-ood
  ☆28Updated 5 years ago
• lxk00 / BERT-EMD
  ☆50Updated last year
• THUDM / FewNLU
  ☆66Updated 3 years ago
• UKPLab / pytorch-bertflow
  Pytorch-version BERT-flow: One can apply BERT-flow to any PLM within Pytorch framework.
  ☆72Updated 3 years ago
• wakafengfan / simcse-pytorch
  pytorch版simcse无监督语义相似模型
  ☆22Updated 3 years ago
• ShannonAI / Neural-Semi-Supervised-Learning-for-Text-Classification
  Semi-supervised Learning for Sentiment Analysis
  ☆54Updated 4 years ago
• jind11 / TitleStylist
  Source code for our "TitleStylist" paper at ACL 2020
  ☆76Updated 7 months ago
• asappresearch / revisit-bert-finetuning
  For the code release of our arXiv paper "Revisiting Few-sample BERT Fine-tuning" (https://arxiv.org/abs/2006.05987).
  ☆184Updated last year
• siddsax / XML-CNN
  Pytorch implementation of the paper Deep learning for extreme multi-label text classification
  ☆62Updated last year
• MiuLab / FlowDelta
  FlowDelta: Modeling Flow Information Gain in Reasoning for Conversational Machine Comprehension
  ☆36Updated 2 years ago
• ray075hl / Bi-Model-Intent-And-Slot
  Intent Detection and Slot Filling
  ☆37Updated last year
• DandyQi / MaskedCRF
  ☆46Updated 3 years ago
• HongyuGong / RCM-Question-Answering
  ☆28Updated 4 years ago
• sz128 / few_shot_slot_tagging_and_NER
  PyTorch implementation of the paper: Vector Projection Network for Few-shot Slot Tagging in Natural Language Understanding. Su Zhu, Ruish…
  ☆18Updated 3 years ago
• tdopierre / FewShotText
  Library of various Few-Shot Learning frameworks for text classification
  ☆60Updated 2 years ago
• alvinchangw / COCON_ICLR2021
  Pytorch implementation of CoCon: A Self-Supervised Approach for Controlled Text Generation
  ☆93Updated 3 years ago
• juand-r / EMNLP-2020
  Selections from EMNLP 2020
  ☆59Updated 3 years ago
• LeeSureman / Sequence-Labeling-Early-Exit
  Code for ACL 2021 paper: Accelerating BERT Inference for Sequence Labeling via Early-Exit
  ☆28Updated 2 years ago