Alternatives and similar repositories for knowledge-distillation

Users that are interested in knowledge-distillation are comparing it to the libraries listed below

• fursovia / self-adj-dice
  Implementation of Self-adjusting Dice Loss from "Dice Loss for Data-imbalanced NLP Tasks" paper
  ☆109Updated 5 years ago
• asappresearch / revisit-bert-finetuning
  For the code release of our arXiv paper "Revisiting Few-sample BERT Fine-tuning" (https://arxiv.org/abs/2006.05987).
  ☆184Updated 2 years ago
• lonePatient / electra_pytorch
  ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators
  ☆91Updated 4 years ago
• zhongyuchen / few-shot-text-classification
  Few-shot binary text classification with Induction Networks and Word2Vec weights initialization
  ☆109Updated last year
• morningmoni / HiLAP
  Code for paper "Hierarchical Text Classification with Reinforced Label Assignment" EMNLP 2019
  ☆138Updated 4 years ago
• varunkumar-dev / TransformersDataAugmentation
  Code associated with the "Data Augmentation using Pre-trained Transformer Models" paper
  ☆136Updated 2 years ago
• kevinmtian / distill-bert
  Knowledge Distillation from BERT
  ☆54Updated 6 years ago
• ray075hl / Bi-Model-Intent-And-Slot
  Intent Detection and Slot Filling
  ☆39Updated 2 years ago
• lonePatient / BERT-SDA
  A PyTorch implementation of "Improving BERT Fine-Tuning via Self-Ensemble and Self-Distillation"
  ☆56Updated 5 years ago
• intersun / PKD-for-BERT-Model-Compression
  pytorch implementation for Patient Knowledge Distillation for BERT Model Compression
  ☆204Updated 6 years ago
• czhang99 / Capsule-NLU
  Joint Slot Filling and Intent Detection via Capsule Neural Networks (ACL'19) https://arxiv.org/abs/1812.09471
  ☆139Updated 2 years ago
• lancopku / Seq2Set
  Code for the paper "A Deep Reinforced Sequence-to-Set Model for Multi-Label Classification"
  ☆50Updated 5 years ago
• allenai / allennlp-reading-comprehension
  ☆86Updated 5 years ago
• bojone / labse
  Language-agnostic BERT Sentence Embedding (LaBSE)
  ☆153Updated 5 years ago
• rikeda71 / TorchCRF
  An Inplementation of CRF (Conditional Random Fields) in PyTorch 1.0
  ☆137Updated 5 years ago
• nayeon7lee / bert-summarization
  ☆121Updated 3 years ago
• ShannonAI / dice_loss_for_NLP
  The repo contains the code of the ACL2020 paper `Dice Loss for Data-imbalanced NLP Tasks`
  ☆274Updated 2 years ago
• UKPLab / pytorch-bertflow
  Pytorch-version BERT-flow: One can apply BERT-flow to any PLM within Pytorch framework.
  ☆72Updated 4 years ago
• zxlzr / MTM
  MTM
  ☆143Updated 3 years ago
• shehzaadzd / pytorch-pretrained-BERT
  A PyTorch implementation of Google AI's BERT model provided with Google's pre-trained models, examples and utilities.
  ☆35Updated 6 years ago
• thu-coai / seq2seq-pytorch-bert
  ☆25Updated 5 years ago
• joongbo / tta
  Repository for the paper "Fast and Accurate Deep Bidirectional Language Representations for Unsupervised Learning"
  ☆110Updated 5 years ago
• microsoft / MT-DNN
  Multi-Task Deep Neural Networks for Natural Language Understanding
  ☆166Updated 2 years ago
• 1024er / cbert_aug
  ☆66Updated 3 years ago
• neulab / SpanNER
  SpanNER: Named EntityRe-/Recognition as Span Prediction
  ☆131Updated 3 years ago
• INK-USC / TriggerNER
  TriggerNER: Learning with Entity Triggers as Explanations for Named Entity Recognition (ACL 2020)
  ☆172Updated 3 years ago
• beekbin / bert-cosine-sim
  Fine-tune BERT to generate sentence embedding for cosine similarity
  ☆69Updated 6 years ago
• ShannonAI / Neural-Semi-Supervised-Learning-for-Text-Classification
  Semi-supervised Learning for Sentiment Analysis
  ☆54Updated 5 years ago
• saurabhkulkarni77 / DistillBERT
  ☆61Updated 6 years ago
• mawentao277 / CharBERT
  CharBERT: Character-aware Pre-trained Language Model (COLING2020)
  ☆121Updated 4 years ago