Kennethborup / knowledgeDistillationLinks
PyTorch implementation of (Hinton) Knowledge Distillation and a base class for simple implementation of other distillation methods.
☆29Updated 5 years ago
Alternatives and similar repositories for knowledgeDistillation
Users that are interested in knowledgeDistillation are comparing it to the libraries listed below
Sorting:
- PyTorch, PyTorch Lightning framework for trying knowledge distillation in image classification problems☆32Updated last year
- A Python Package for Deep Imbalanced Learning☆57Updated 6 months ago
- PyTorch implementation of Soft MoE by Google Brain in "From Sparse to Soft Mixtures of Experts" (https://arxiv.org/pdf/2308.00951.pdf)☆82Updated 2 years ago
- several types of attention modules written in PyTorch for learning purposes☆53Updated 3 weeks ago
- Demonstration of transfer of knowledge and generalization with distillation☆55Updated 7 years ago
- Implementation of TableFormer, Robust Transformer Modeling for Table-Text Encoding, in Pytorch☆39Updated 3 years ago
- Stochastic Weight Averaging Tutorials using pytorch.☆33Updated 5 years ago
- IJCAI 2021, "Comparing Kullback-Leibler Divergence and Mean Squared Error Loss in Knowledge Distillation"☆42Updated 3 years ago
- PyTorch implementation of moe, which stands for mixture of experts☆52Updated 4 years ago
- ☆95Updated last year
- Repo to reproduce results for Where to Begin? On the Impact of Pre-Training and Initialization in Federated Learning☆25Updated 2 years ago
- Benchmarking algorithms for assessing quality of data labeled by multiple annotators☆34Updated last month
- Paper List for Multi-Task Learning (focus on architectures and optimization for MTL)☆51Updated 2 years ago
- ZSKD with PyTorch☆31Updated 2 years ago
- A regularized self-labeling approach to improve the generalization and robustness of fine-tuned models☆27Updated 3 years ago
- Recycling diverse models☆46Updated 3 years ago
- Adversarial examples to the new ConvNeXt architecture☆20Updated 4 years ago
- Code for the PAPA paper☆27Updated 3 years ago
- PyTorch reimplementation of computing Shapley values via Truncated Monte Carlo sampling from "What is your data worth? Equitable Valuatio…☆27Updated 4 years ago
- Towards Understanding the Mixture-of-Experts Layer in Deep Learning☆34Updated 2 years ago
- This resposity maintains a collection of important papers on knowledge distillation (awesome-knowledge-distillation)).☆82Updated 10 months ago
- Pytorch implementations of Co-teaching for noisy label learning☆13Updated 3 years ago
- A package for fine tuning of pretrained NLP transformers using Semi Supervised Learning☆14Updated 4 years ago
- A project to add scalable state-of-the-art out-of-distribution detection (open set recognition) support by changing two lines of code! Pe…☆79Updated 3 years ago
- PyTorch implementation for "Few-Shot Learning with Class Imbalance"☆37Updated 4 years ago
- The implementation of VGG thesis is implemented under PyTorch framework☆38Updated 3 years ago
- [ACL 2023] Code for paper “Tailoring Instructions to Student’s Learning Levels Boosts Knowledge Distillation”(https://arxiv.org/abs/2305.…☆38Updated 2 years ago
- Unofficial Pytorch Implementation Of AdversarialAutoAugment(ICLR2020)☆21Updated 4 years ago
- code for the ddp tutorial☆32Updated 3 years ago
- ☆31Updated 8 months ago