HobbitLong / RepDistiller
[ICLR 2020] Contrastive Representation Distillation (CRD), and benchmark of recent knowledge distillation methods
☆2,158Updated 11 months ago
Related projects: ⓘ
- Awesome Knowledge-Distillation. 分类整理的知识蒸馏paper(2014-2021)。☆2,468Updated last year
- Pytorch implementation of various Knowledge Distillation (KD) methods.☆1,579Updated 2 years ago
- A PyTorch implementation for exploring deep and shallow knowledge distillation (KD) experiments with flexibility☆1,834Updated last year
- label-smooth, amsoftmax, partial-fc, focal-loss, triplet-loss, lovasz-softmax. Maybe useful☆2,159Updated last year
- PyTorch implementation of "Supervised Contrastive Learning" (and SimCLR incidentally)☆3,056Updated 8 months ago
- PyTorch implementation of Contrastive Learning methods☆1,932Updated 11 months ago
- Awesome Knowledge Distillation☆3,417Updated 3 weeks ago
- OpenMMLab Self-Supervised Learning Toolbox and Benchmark☆3,167Updated last year
- A curated list of neural network pruning resources.☆2,329Updated 5 months ago
- PyTorch implementation of MoCo: https://arxiv.org/abs/1911.05722☆4,721Updated last month
- PyTorch implementation of SimCLR: A Simple Framework for Contrastive Learning of Visual Representations☆2,216Updated 6 months ago
- Count the MACs / FLOPs of your PyTorch model.☆4,832Updated 2 months ago
- OpenMMLab Model Compression Toolbox and Benchmark.☆1,452Updated 3 months ago
- Proper implementation of ResNet-s for CIFAR10/100 in pytorch that matches description of the original paper.☆1,199Updated 3 months ago
- PyTorch implementation of SimSiam https//arxiv.org/abs/2011.10566☆1,146Updated last year
- Flops counter for convolutional networks in pytorch framework☆2,783Updated 2 months ago
- The official implementation of [CVPR2022] Decoupled Knowledge Distillation https://arxiv.org/abs/2203.08679 and [ICCV2023] DOT: A Distill…☆787Updated 10 months ago
- A quickstart and benchmark for pytorch distributed training.☆1,617Updated last month
- Pytorch reimplementation of the Vision Transformer (An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale)☆1,893Updated 2 years ago
- Usable Implementation of "Bootstrap Your Own Latent" self-supervised learning, from Deepmind, in Pytorch☆1,732Updated 2 months ago
- knowledge distillation papers☆736Updated last year
- RepVGG: Making VGG-style ConvNets Great Again☆3,306Updated last year
- PyTorch implementation of MoCo v3 https//arxiv.org/abs/2104.02057☆1,201Updated 2 years ago
- A coding-free framework built on PyTorch for reproducible deep learning studies. 🏆25 knowledge distillation methods presented at CVPR, I…☆1,351Updated 2 weeks ago
- mixup: Beyond Empirical Risk Minimization☆1,156Updated 2 years ago
- A curated list of resources for Learning with Noisy Labels☆2,621Updated 4 months ago
- This is a collection of our NAS and Vision Transformer work.☆1,655Updated last month
- A PyTorch-based library for semi-supervised learning (NeurIPS'21)☆1,290Updated last year
- Classification with PyTorch.☆1,675Updated 3 months ago
- Official PyTorch code for "BAM: Bottleneck Attention Module (BMVC2018)" and "CBAM: Convolutional Block Attention Module (ECCV2018)"☆2,036Updated last year