HobbitLong / RepDistillerLinks
[ICLR 2020] Contrastive Representation Distillation (CRD), and benchmark of recent knowledge distillation methods
☆2,345Updated last year
Alternatives and similar repositories for RepDistiller
Users that are interested in RepDistiller are comparing it to the libraries listed below
Sorting:
- Awesome Knowledge-Distillation. 分类整理的知识蒸馏paper(2014-2021)。☆2,602Updated 2 years ago
- Pytorch implementation of various Knowledge Distillation (KD) methods.☆1,703Updated 3 years ago
- Awesome Knowledge Distillation☆3,687Updated last week
- OpenMMLab Model Compression Toolbox and Benchmark.☆1,603Updated last year
- A PyTorch implementation for exploring deep and shallow knowledge distillation (KD) experiments with flexibility☆1,945Updated 2 years ago
- The official implementation of [CVPR2022] Decoupled Knowledge Distillation https://arxiv.org/abs/2203.08679 and [ICCV2023] DOT: A Distill…☆861Updated last year
- OpenMMLab Self-Supervised Learning Toolbox and Benchmark☆3,266Updated last year
- PyTorch implementation of MoCo: https://arxiv.org/abs/1911.05722☆4,998Updated last month
- PyTorch implementation of Contrastive Learning methods☆1,984Updated last year
- label-smooth, amsoftmax, partial-fc, focal-loss, triplet-loss, lovasz-softmax. Maybe useful☆2,243Updated 8 months ago
- A coding-free framework built on PyTorch for reproducible deep learning studies. PyTorch Ecosystem. 🏆25 knowledge distillation methods p…☆1,516Updated last month
- RepVGG: Making VGG-style ConvNets Great Again☆3,394Updated 2 years ago
- Count the MACs / FLOPs of your PyTorch model.☆5,006Updated 11 months ago
- PyTorch implementation of "Supervised Contrastive Learning" (and SimCLR incidentally)☆3,304Updated last year
- Flops counter for neural networks in pytorch framework☆2,904Updated 5 months ago
- My best practice of training large dataset using PyTorch.☆1,100Updated last year
- PyTorch implementation of SimCLR: A Simple Framework for Contrastive Learning of Visual Representations☆2,403Updated last year
- [arXiv 2019] "Contrastive Multiview Coding", also contains implementations for MoCo and InstDis☆1,325Updated 4 years ago
- knowledge distillation papers☆757Updated 2 years ago
- Collect some papers about transformer with vision. Awesome Transformer with Computer Vision (CV)☆3,495Updated 5 months ago
- A curated list of neural network pruning resources.☆2,453Updated last year
- A quickstart and benchmark for pytorch distributed training.☆1,668Updated 10 months ago
- Unofficial PyTorch implementation of Masked Autoencoders Are Scalable Vision Learners☆2,655Updated last year
- Knowledge Distillation: CVPR2020 Oral, Revisiting Knowledge Distillation via Label Smoothing Regularization☆583Updated 2 years ago
- ICCV2021, Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNet☆1,188Updated last year
- Official DeiT repository☆4,216Updated last year
- PyTorch implementation of SwAV https//arxiv.org/abs/2006.09882☆2,045Updated 2 years ago
- PoolFormer: MetaFormer Is Actually What You Need for Vision (CVPR 2022 Oral)☆1,341Updated last year
- PyTorch implementation of SimSiam https//arxiv.org/abs/2011.10566☆1,196Updated 2 years ago
- PyTorch implementation of MoCo v3 https//arxiv.org/abs/2104.02057☆1,272Updated 3 years ago