Kennethborup / knowledgeDistillationLinks
PyTorch implementation of (Hinton) Knowledge Distillation and a base class for simple implementation of other distillation methods.
☆28Updated 4 years ago
Alternatives and similar repositories for knowledgeDistillation
Users that are interested in knowledgeDistillation are comparing it to the libraries listed below
Sorting:
- Stochastic Weight Averaging Tutorials using pytorch.☆33Updated 4 years ago
- ZSKD with PyTorch☆31Updated last year
- Repo to reproduce results for Where to Begin? On the Impact of Pre-Training and Initialization in Federated Learning☆25Updated 2 years ago
- This resposity maintains a collection of important papers on knowledge distillation (awesome-knowledge-distillation)).☆78Updated 2 months ago
- IJCAI 2021, "Comparing Kullback-Leibler Divergence and Mean Squared Error Loss in Knowledge Distillation"☆41Updated 2 years ago
- Code for Active Mixup in 2020 CVPR☆23Updated 3 years ago
- Data-free knowledge distillation using Gaussian noise (NeurIPS paper)☆15Updated 2 years ago
- Code for the PAPA paper☆27Updated 2 years ago
- Demonstration of transfer of knowledge and generalization with distillation☆54Updated 6 years ago
- Official Pytorch Implementation of Unsupervised Representation Learning for Binary Networks by Joint Classifier Training (CVPR 2022)☆10Updated 3 years ago
- PyTorch, PyTorch Lightning framework for trying knowledge distillation in image classification problems☆32Updated 10 months ago
- Contains notebooks for the PAR tutorial at CVPR 2021.☆36Updated 3 years ago
- Implementation of TableFormer, Robust Transformer Modeling for Table-Text Encoding, in Pytorch☆39Updated 3 years ago
- The official implementation of You Only Compress Once: Towards Effective and Elastic BERT Compression via Exploit-Explore Stochastic Natu…☆48Updated 3 years ago
- label smoothing PyTorch implementation☆32Updated 4 years ago
- Prospect Pruning: Finding Trainable Weights at Initialization Using Meta-Gradients☆31Updated 3 years ago
- Pytorch implementation of our paper accepted by IEEE TNNLS, 2022 -- Distilling a Powerful Student Model via Online Knowledge Distillation☆28Updated 3 years ago
- Pytorch code for managing distributed training experiments.☆21Updated 5 years ago
- Interpretable Explanations of Black Boxes by Meaningful Perturbation Pytorch☆12Updated 9 months ago
- AutoLossGen: Automatic Loss Function Generation for Recommender Systems☆22Updated 3 years ago
- Paper List for Multi-Task Learning (focus on architectures and optimization for MTL)☆47Updated last year
- Github for the conference paper GLOD-Gaussian Likelihood OOD detector☆16Updated 3 years ago
- AAAI 2021: Robustness of Accuracy Metric and its Inspirations in Learning with Noisy Labels☆23Updated 3 years ago
- A regularized self-labeling approach to improve the generalization and robustness of fine-tuned models☆28Updated 3 years ago
- A Pytorch implementation of "Data-Free Learning of Student Networks" (ICCV 2019).☆17Updated 5 years ago
- Pytorch implementations of Co-teaching for noisy label learning☆13Updated 2 years ago
- PyTorch reimplementation of computing Shapley values via Truncated Monte Carlo sampling from "What is your data worth? Equitable Valuatio…☆27Updated 3 years ago
- ICLR 2022 Paper submission trend analysis from https://openreview.net/group?id=ICLR.cc/2022/Conference☆84Updated 2 years ago
- FedCV: An Industrial-grade Federated Learning Framework for Diverse Computer Vision Tasks☆66Updated 11 months ago
- Pytorch implementation for "The Surprising Positive Knowledge Transfer in Continual 3D Object Shape Reconstruction"☆33Updated 2 years ago