Kennethborup / knowledgeDistillation
PyTorch implementation of (Hinton) Knowledge Distillation and a base class for simple implementation of other distillation methods.
☆28Updated 4 years ago
Alternatives and similar repositories for knowledgeDistillation:
Users that are interested in knowledgeDistillation are comparing it to the libraries listed below
- A regularized self-labeling approach to improve the generalization and robustness of fine-tuned models☆28Updated 2 years ago
- Data-free knowledge distillation using Gaussian noise (NeurIPS paper)☆15Updated last year
- IJCAI 2021, "Comparing Kullback-Leibler Divergence and Mean Squared Error Loss in Knowledge Distillation"☆40Updated 2 years ago
- PyTorch, PyTorch Lightning framework for trying knowledge distillation in image classification problems☆32Updated 7 months ago
- ☆29Updated last year
- Recycling diverse models☆44Updated 2 years ago
- Code for paper: “What Data Benefits My Classifier?” Enhancing Model Performance and Interpretability through Influence-Based Data Selecti…☆22Updated 9 months ago
- sharpDARTS: Faster and More Accurate Differentiable Architecture Search☆16Updated 4 years ago
- ZSKD with PyTorch☆30Updated last year
- Advances in Neural Information Processing Systems (NeurIPS 2021)☆22Updated 2 years ago
- Code for Active Mixup in 2020 CVPR☆22Updated 3 years ago
- Pytorch implementation for "The Surprising Positive Knowledge Transfer in Continual 3D Object Shape Reconstruction"☆33Updated 2 years ago
- Github for the conference paper GLOD-Gaussian Likelihood OOD detector☆16Updated 2 years ago
- ☆34Updated 2 years ago
- label smoothing PyTorch implementation☆32Updated 4 years ago
- Offical Repo for Firefly Neural Architecture Descent: a General Approach for Growing Neural Networks. Accepted by Neurips 2020.☆31Updated 4 years ago
- Unofficial Pytorch Implementation Of AdversarialAutoAugment(ICLR2020)☆21Updated 4 years ago
- AAAI 2021: Robustness of Accuracy Metric and its Inspirations in Learning with Noisy Labels☆23Updated 3 years ago
- Code for Overinterpretation paper☆19Updated last year
- Code for the paper "Pretrained Models for Multilingual Federated Learning" at NAACL 2022☆10Updated 2 years ago
- Implementation of the paper Identifying Mislabeled Data using the Area Under the Margin Ranking: https://arxiv.org/pdf/2001.10528v2.pdf☆21Updated 5 years ago
- Code for CVPR2021 paper: MOOD: Multi-level Out-of-distribution Detection☆38Updated last year
- Code for the PAPA paper☆27Updated 2 years ago
- The official GitHub page for paper "NegativePrompt: Leveraging Psychology for Large Language Models Enhancement via Negative Emotional St…☆20Updated 10 months ago
- This repo is for our paper: Normalization Techniques in Training DNNs: Methodology, Analysis and Application☆84Updated 3 years ago
- ☆11Updated 2 years ago
- Contains notebooks for the PAR tutorial at CVPR 2021.☆36Updated 3 years ago
- several types of attention modules written in PyTorch for learning purposes☆46Updated 5 months ago
- ☆17Updated 2 years ago
- [ICLR 2022] "Learning Pruning-Friendly Networks via Frank-Wolfe: One-Shot, Any-Sparsity, and No Retraining" by Lu Miao*, Xiaolong Luo*, T…☆29Updated 3 years ago