FLHonker / Awesome-Knowledge-Distillation
Awesome Knowledge-Distillation. 分类整理的知识蒸馏paper(2014-2021)。
☆2,497Updated last year
Related projects ⓘ
Alternatives and complementary repositories for Awesome-Knowledge-Distillation
- Pytorch implementation of various Knowledge Distillation (KD) methods.☆1,614Updated 2 years ago
- [ICLR 2020] Contrastive Representation Distillation (CRD), and benchmark of recent knowledge distillation methods☆2,197Updated last year
- Awesome Knowledge Distillation☆3,479Updated last month
- A PyTorch implementation for exploring deep and shallow knowledge distillation (KD) experiments with flexibility☆1,864Updated last year
- knowledge distillation papers☆741Updated last year
- label-smooth, amsoftmax, partial-fc, focal-loss, triplet-loss, lovasz-softmax. Maybe useful☆2,183Updated last month
- A curated list of neural network pruning resources.☆2,361Updated 7 months ago
- The official implementation of [CVPR2022] Decoupled Knowledge Distillation https://arxiv.org/abs/2203.08679 and [ICCV2023] DOT: A Distill…☆807Updated last year
- A quickstart and benchmark for pytorch distributed training.☆1,640Updated 3 months ago
- PyTorch implementation of Contrastive Learning methods☆1,942Updated last year
- Some tricks of pytorch...☆1,160Updated 5 months ago
- Collection for Few-shot Learning☆973Updated last year
- A curated list of resources for Learning with Noisy Labels☆2,640Updated 6 months ago
- Knowledge Distillation: CVPR2020 Oral, Revisiting Knowledge Distillation via Label Smoothing Regularization☆580Updated last year
- A coding-free framework built on PyTorch for reproducible deep learning studies. 🏆25 knowledge distillation methods presented at CVPR, I…☆1,392Updated last month
- Count the MACs / FLOPs of your PyTorch model.☆4,888Updated 4 months ago
- mixup: Beyond Empirical Risk Minimization☆1,168Updated 3 years ago
- Flops counter for convolutional networks in pytorch framework☆2,822Updated last month
- OpenMMLab Model Compression Toolbox and Benchmark.☆1,479Updated 5 months ago
- This repository contains code for the paper "Decoupling Representation and Classifier for Long-Tailed Recognition", published at ICLR 202…☆946Updated 3 years ago
- Collection of recent methods on (deep) neural network compression and acceleration.☆930Updated 2 months ago
- My best practice of training large dataset using PyTorch.☆1,086Updated 6 months ago
- PyTorch implementation of SimCLR: A Simple Framework for Contrastive Learning of Visual Representations☆2,265Updated 8 months ago
- A comprehensive list of awesome contrastive self-supervised learning papers.☆1,227Updated 2 months ago
- micronet, a model compression and deploy lib. compression: 1、quantization: quantization-aware-training(QAT), High-Bit(>2b)(DoReFa/Quantiz…☆2,219Updated 3 years ago
- PyTorch implementation of MoCo: https://arxiv.org/abs/1911.05722☆4,799Updated last month
- PyTorch implementation of "Supervised Contrastive Learning" (and SimCLR incidentally)☆3,122Updated 10 months ago
- Model analyzer in PyTorch☆1,468Updated last year
- list of efficient attention modules☆989Updated 3 years ago
- Elegant PyTorch implementation of paper Model-Agnostic Meta-Learning (MAML)☆2,318Updated 5 years ago