Alternatives and similar repositories for knowledge-distillation

Users that are interested in knowledge-distillation are comparing it to the libraries listed below

• morningmoni / HiLAP
  Code for paper "Hierarchical Text Classification with Reinforced Label Assignment" EMNLP 2019
  ☆139Updated 3 years ago
• varunkumar-dev / TransformersDataAugmentation
  Code associated with the "Data Augmentation using Pre-trained Transformer Models" paper
  ☆132Updated 2 years ago
• jasonwei20 / triplet-loss
  ☆42Updated 4 years ago
• fursovia / self-adj-dice
  Implementation of Self-adjusting Dice Loss from "Dice Loss for Data-imbalanced NLP Tasks" paper
  ☆108Updated 4 years ago
• JasonForJoy / SA-BERT
  CIKM 2020: Speaker-Aware BERT for Multi-Turn Response Selection in Retrieval-Based Chatbots
  ☆74Updated 4 years ago
• asappresearch / revisit-bert-finetuning
  For the code release of our arXiv paper "Revisiting Few-sample BERT Fine-tuning" (https://arxiv.org/abs/2006.05987).
  ☆184Updated 2 years ago
• lonePatient / BERT-SDA
  A PyTorch implementation of "Improving BERT Fine-Tuning via Self-Ensemble and Self-Distillation"
  ☆56Updated 5 years ago
• zxlzr / MTM
  MTM
  ☆142Updated 2 years ago
• UKPLab / pytorch-bertflow
  Pytorch-version BERT-flow: One can apply BERT-flow to any PLM within Pytorch framework.
  ☆72Updated 3 years ago
• BinWang28 / SBERT-WK-Sentence-Embedding
  IEEE/ACM TASLP 2020: SBERT-WK: A Sentence Embedding Method By Dissecting BERT-based Word Models
  ☆179Updated 4 years ago
• jind11 / TitleStylist
  Source code for our "TitleStylist" paper at ACL 2020
  ☆76Updated 11 months ago
• kevinmtian / distill-bert
  Knowledge Distillation from BERT
  ☆52Updated 6 years ago
• INK-USC / TriggerNER
  TriggerNER: Learning with Entity Triggers as Explanations for Named Entity Recognition (ACL 2020)
  ☆172Updated 3 years ago
• juand-r / EMNLP-2020
  Selections from EMNLP 2020
  ☆59Updated 4 years ago
• neulab / SpanNER
  SpanNER: Named EntityRe-/Recognition as Span Prediction
  ☆131Updated 3 years ago
• amir-zeldes / biaffine-ner
  Named Entity Recognition as Dependency Parsing
  ☆39Updated 5 years ago
• cooelf / SemBERT
  Semantics-aware BERT for Language Understanding (AAAI 2020)
  ☆288Updated 2 years ago
• thu-coai / seq2seq-pytorch-bert
  ☆25Updated 5 years ago
• ChenRocks / Distill-BERT-Textgen
  Research code for ACL 2020 paper: "Distilling Knowledge Learned in BERT for Text Generation".
  ☆131Updated 4 years ago
• OctoberChang / X-Transformer
  X-Transformer: Taming Pretrained Transformers for eXtreme Multi-label Text Classification
  ☆138Updated 4 years ago
• beekbin / bert-cosine-sim
  Fine-tune BERT to generate sentence embedding for cosine similarity
  ☆69Updated 5 years ago
• dsindex / ntagger
  reference pytorch code for named entity tagging
  ☆86Updated 8 months ago
• czhang99 / Capsule-NLU
  Joint Slot Filling and Intent Detection via Capsule Neural Networks (ACL'19) https://arxiv.org/abs/1812.09471
  ☆139Updated 2 years ago
• zhongyuchen / few-shot-text-classification
  Few-shot binary text classification with Induction Networks and Word2Vec weights initialization
  ☆108Updated 11 months ago
• 1024er / cbert_aug
  ☆67Updated 3 years ago
• joongbo / tta
  Repository for the paper "Fast and Accurate Deep Bidirectional Language Representations for Unsupervised Learning"
  ☆109Updated 4 years ago
• bojone / labse
  Language-agnostic BERT Sentence Embedding (LaBSE)
  ☆152Updated 4 years ago
• 90217 / joint-intent-classification-and-slot-filling-based-on-BERT
  BERT for joint intent classification and slot filling
  ☆39Updated 5 years ago
• Adaxry / GCDT
  Code for the paper: GCDT: A Global Context Enhanced Deep Transition Architecture for Sequence Labeling
  ☆66Updated 5 years ago
• Andrew03 / transformer-abstractive-summarization
  Code for the paper "Efficient Adaption of Pretrained Transformers for Abstractive Summarization"
  ☆71Updated 6 years ago