AberHu / Knowledge-Distillation-Zoo
Pytorch implementation of various Knowledge Distillation (KD) methods.
☆1,690Updated 3 years ago
Alternatives and similar repositories for Knowledge-Distillation-Zoo
Users that are interested in Knowledge-Distillation-Zoo are comparing it to the libraries listed below
Sorting:
- A PyTorch implementation for exploring deep and shallow knowledge distillation (KD) experiments with flexibility☆1,933Updated 2 years ago
- Awesome Knowledge-Distillation. 分类整理的知识蒸馏paper(2014-2021)。☆2,584Updated last year
- [ICLR 2020] Contrastive Representation Distillation (CRD), and benchmark of recent knowledge distillation methods☆2,327Updated last year
- knowledge distillation papers☆753Updated 2 years ago
- Awesome Knowledge Distillation☆3,668Updated 2 months ago
- The official implementation of [CVPR2022] Decoupled Knowledge Distillation https://arxiv.org/abs/2203.08679 and [ICCV2023] DOT: A Distill…☆853Updated last year
- A curated list of neural network pruning resources.☆2,440Updated last year
- A coding-free framework built on PyTorch for reproducible deep learning studies. PyTorch Ecosystem. 🏆25 knowledge distillation methods p…☆1,499Updated this week
- Knowledge Distillation: CVPR2020 Oral, Revisiting Knowledge Distillation via Label Smoothing Regularization☆586Updated 2 years ago
- label-smooth, amsoftmax, partial-fc, focal-loss, triplet-loss, lovasz-softmax. Maybe useful☆2,241Updated 6 months ago
- A quickstart and benchmark for pytorch distributed training.☆1,661Updated 9 months ago
- Collection of recent methods on (deep) neural network compression and acceleration.☆947Updated last month
- A Pytorch Knowledge Distillation library for benchmarking and extending works in the domains of Knowledge Distillation, Pruning, and Quan…☆625Updated 2 years ago
- PyTorch implementation of Contrastive Learning methods☆1,979Updated last year
- Flops counter for neural networks in pytorch framework☆2,891Updated 3 months ago
- mixup: Beyond Empirical Risk Minimization☆1,178Updated 3 years ago
- experiments on Paper <Bag of Tricks for Image Classification with Convolutional Neural Networks> and other useful tricks to improve CNN a…☆727Updated 6 years ago
- Rethinking the Value of Network Pruning (Pytorch) (ICLR 2019)☆1,514Updated 4 years ago
- Gradually-Warmup Learning Rate Scheduler for PyTorch☆989Updated 7 months ago
- micronet, a model compression and deploy lib. compression: 1、quantization: quantization-aware-training(QAT), High-Bit(>2b)(DoReFa/Quantiz…☆2,247Updated last week
- Efficient computing methods developed by Huawei Noah's Ark Lab☆1,268Updated 6 months ago
- My best practice of training large dataset using PyTorch.☆1,098Updated last year
- Model analyzer in PyTorch☆1,482Updated 2 years ago
- Network Slimming (Pytorch) (ICCV 2017)☆914Updated 4 years ago
- PyTorch implementation of "Supervised Contrastive Learning" (and SimCLR incidentally)☆3,274Updated last year
- RepVGG: Making VGG-style ConvNets Great Again☆3,390Updated 2 years ago
- A curated list of resources for Learning with Noisy Labels☆2,680Updated last week
- Official PyTorch implementation of "A Comprehensive Overhaul of Feature Distillation" (ICCV 2019)☆418Updated 4 years ago
- Proper implementation of ResNet-s for CIFAR10/100 in pytorch that matches description of the original paper.☆1,275Updated 10 months ago
- A comprehensive list of awesome contrastive self-supervised learning papers.☆1,269Updated 8 months ago