Alternatives and similar repositories for knowledge-distillation:

Users that are interested in knowledge-distillation are comparing it to the libraries listed below

• kevinmtian / distill-bert
  Knowledge Distillation from BERT
  ☆52Updated 6 years ago
• JasonForJoy / SA-BERT
  CIKM 2020: Speaker-Aware BERT for Multi-Turn Response Selection in Retrieval-Based Chatbots
  ☆74Updated 4 years ago
• neulab / SpanNER
  SpanNER: Named EntityRe-/Recognition as Span Prediction
  ☆124Updated 2 years ago
• jasonwei20 / triplet-loss
  ☆42Updated 4 years ago
• asappresearch / revisit-bert-finetuning
  For the code release of our arXiv paper "Revisiting Few-sample BERT Fine-tuning" (https://arxiv.org/abs/2006.05987).
  ☆184Updated last year
• UKPLab / pytorch-bertflow
  Pytorch-version BERT-flow: One can apply BERT-flow to any PLM within Pytorch framework.
  ☆72Updated 3 years ago
• varunkumar-dev / TransformersDataAugmentation
  Code associated with the "Data Augmentation using Pre-trained Transformer Models" paper
  ☆132Updated last year
• juand-r / EMNLP-2020
  Selections from EMNLP 2020
  ☆60Updated 3 years ago
• thu-coai / seq2seq-pytorch-bert
  ☆25Updated 4 years ago
• lxk00 / BERT-EMD
  ☆50Updated last year
• jind11 / TitleStylist
  Source code for our "TitleStylist" paper at ACL 2020
  ☆76Updated 6 months ago
• 1024er / cbert_aug
  ☆66Updated 2 years ago
• lonePatient / BERT-SDA
  A PyTorch implementation of "Improving BERT Fine-Tuning via Self-Ensemble and Self-Distillation"
  ☆56Updated 4 years ago
• fursovia / self-adj-dice
  Implementation of Self-adjusting Dice Loss from "Dice Loss for Data-imbalanced NLP Tasks" paper
  ☆107Updated 4 years ago
• lonePatient / electra_pytorch
  ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators
  ☆91Updated 3 years ago
• tdopierre / FewShotText
  Library of various Few-Shot Learning frameworks for text classification
  ☆60Updated 2 years ago
• dinghanshen / Cutoff
  The source code for the Cutoff data augmentation approach proposed in this paper: "A Simple but Tough-to-Beat Data Augmentation Approach …
  ☆62Updated 4 years ago
• ChenRocks / Distill-BERT-Textgen
  Research code for ACL 2020 paper: "Distilling Knowledge Learned in BERT for Text Generation".
  ☆131Updated 3 years ago
• zhongyuchen / few-shot-text-classification
  Few-shot binary text classification with Induction Networks and Word2Vec weights initialization
  ☆108Updated 6 months ago
• henryhungle / NADST
  Code for the paper Non-Autoregressive Dialog State Tracking (ICLR20)
  ☆45Updated 4 years ago
• THUDM / FewNLU
  ☆66Updated 3 years ago
• sweetalyssum / Seq2Seq-DU
  ☆41Updated 3 years ago
• kedz / summarization-datasets
  Pre-processing and in some cases downloading of datasets for the paper "Content Selection in Deep Learning Models of Summarization."
  ☆78Updated 2 years ago
• Sanyuan-Chen / RecAdam
  Code for the RecAdam paper: Recall and Learn: Fine-tuning Deep Pretrained Language Models with Less Forgetting.
  ☆115Updated 4 years ago
• ray075hl / Bi-Model-Intent-And-Slot
  Intent Detection and Slot Filling
  ☆37Updated last year
• jinfengr / hcan
  EMNLP'19: Bridging the Gap between Relevance Matching and Semantic Matching for Short Text Similarity Modeling
  ☆77Updated last year
• Andrew03 / transformer-abstractive-summarization
  Code for the paper "Efficient Adaption of Pretrained Transformers for Abstractive Summarization"
  ☆71Updated 5 years ago
• RowitZou / RankAE
  AAAI-2021 paper: Unsupervised Summarization for Chat Logs with Topic-Oriented Ranking and Context-Aware Auto-Encoders.
  ☆38Updated 3 years ago
• zliucr / coach
  Coach: A Coarse-to-Fine Approach for Cross-domain Slot Filling (ACL-2020)
  ☆77Updated 4 years ago
• SLAD-ml / few-shot-ood
  ☆28Updated 5 years ago