Alternatives and similar repositories for knowledgeDistillation

Users that are interested in knowledgeDistillation are comparing it to the libraries listed below

• jhoon-oh / kd_data
  IJCAI 2021, "Comparing Kullback-Leibler Divergence and Mean Squared Error Loss in Knowledge Distillation"
  ☆42Updated 2 years ago
• vrvlive / knowlege-distillation
  PyTorch, PyTorch Lightning framework for trying knowledge distillation in image classification problems
  ☆32Updated last year
• hoya012 / swa-tutorials-pytorch
  Stochastic Weight Averaging Tutorials using pytorch.
  ☆33Updated 4 years ago
• VITA-Group / Nasty-Teacher
  [ICLR 2021 Spotlight Oral] "Undistillable: Making A Nasty Teacher That CANNOT teach students", Haoyu Ma, Tianlong Chen, Ting-Kuei Hu, Che…
  ☆82Updated 3 years ago
• facebookresearch / where_to_begin
  Repo to reproduce results for Where to Begin? On the Impact of Pre-Training and Initialization in Federated Learning
  ☆25Updated 2 years ago
• da2so / Zero-shot_Knowledge_Distillation_Pytorch
  ZSKD with PyTorch
  ☆31Updated 2 years ago
• ilia10000 / dataset-distillation
  Soft-Label Dataset Distillation and Text Dataset Distillation
  ☆74Updated 2 years ago
• fgranese / DOCTOR
  Advances in Neural Information Processing Systems (NeurIPS 2021)
  ☆22Updated 2 years ago
• mansheej / data_diet
  ☆109Updated 2 years ago
• GitiHubi / deepContinualAuditing
  ☆10Updated 3 years ago
• Pengxin-Guo / Awesome-Multi-Task-Learning
  Paper List for Multi-Task Learning (focus on architectures and optimization for MTL)
  ☆51Updated last year
• huawei-noah / Efficient-NLP
  ☆95Updated last year
• DefangChen / Knowledge-Distillation-Paper
  This resposity maintains a collection of important papers on knowledge distillation (awesome-knowledge-distillation)).
  ☆80Updated 6 months ago
• Piyush-555 / GaussianDistillation
  Data-free knowledge distillation using Gaussian noise (NeurIPS paper)
  ☆15Updated 2 years ago
• salesforce / ensemble-of-averages
  ☆31Updated 4 months ago
• knotgrass / attention
  several types of attention modules written in PyTorch for learning purposes
  ☆52Updated 11 months ago
• ttchengab / mixup
  ☆19Updated 4 years ago
• shengliu66 / SOP
  Official Implementation of Robust Training under Label Noise by Over-parameterization
  ☆64Updated 3 years ago
• fkodom / soft-mixture-of-experts
  PyTorch implementation of Soft MoE by Google Brain in "From Sparse to Soft Mixtures of Experts" (https://arxiv.org/pdf/2308.00951.pdf)
  ☆78Updated last year
• facebookresearch / ModelRatatouille
  Recycling diverse models
  ☆45Updated 2 years ago
• VirtuosoResearch / Regularized-Self-Labeling
  A regularized self-labeling approach to improve the generalization and robustness of fine-tuned models
  ☆27Updated 3 years ago
• lucidrains / tableformer-pytorch
  Implementation of TableFormer, Robust Transformer Modeling for Table-Text Encoding, in Pytorch
  ☆39Updated 3 years ago
• orionw / Multilingual-Federated-Learning
  Code for the paper "Pretrained Models for Multilingual Federated Learning" at NAACL 2022
  ☆11Updated 3 years ago
• sayakpaul / par-cvpr-21
  Contains notebooks for the PAR tutorial at CVPR 2021.
  ☆36Updated 4 years ago
• FedML-AI / FedCV
  FedCV: An Industrial-grade Federated Learning Framework for Diverse Computer Vision Tasks
  ☆67Updated last year
• SMILELab-FL / FedNoisy
  Benchmark for federated noisy label learning
  ☆23Updated last year
• ntucllab / imbalanced-DL
  A Python Package for Deep Imbalanced Learning
  ☆57Updated 2 months ago
• dwang181 / active-mixup
  Code for Active Mixup in 2020 CVPR
  ☆23Updated 3 years ago
• YeonwooSung / Pytorch_mixture-of-experts
  PyTorch implementation of moe, which stands for mixture of experts
  ☆48Updated 4 years ago
• raymin0223 / self-contrastive-learning
  Self-Contrastive Learning: Single-viewed Supervised Contrastive Framework using Sub-network (AAAI 2023)
  ☆20Updated last year