HobbitLong / RepDistiller
[ICLR 2020] Contrastive Representation Distillation (CRD), and benchmark of recent knowledge distillation methods
☆2,239Updated last year
Alternatives and similar repositories for RepDistiller:
Users that are interested in RepDistiller are comparing it to the libraries listed below
- Awesome Knowledge-Distillation. 分类整理的知识蒸馏paper(2014-2021)。☆2,539Updated last year
- Pytorch implementation of various Knowledge Distillation (KD) methods.☆1,644Updated 3 years ago
- A PyTorch implementation for exploring deep and shallow knowledge distillation (KD) experiments with flexibility☆1,887Updated last year
- The official implementation of [CVPR2022] Decoupled Knowledge Distillation https://arxiv.org/abs/2203.08679 and [ICCV2023] DOT: A Distill…☆825Updated last year
- Awesome Knowledge Distillation☆3,527Updated 3 weeks ago
- OpenMMLab Model Compression Toolbox and Benchmark.☆1,510Updated 7 months ago
- A coding-free framework built on PyTorch for reproducible deep learning studies. PyTorch Ecosystem. 🏆25 knowledge distillation methods p…☆1,423Updated this week
- OpenMMLab Self-Supervised Learning Toolbox and Benchmark☆3,224Updated last year
- PyTorch implementation of Contrastive Learning methods☆1,952Updated last year
- Pytorch reimplementation of the Vision Transformer (An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale)☆1,978Updated 2 years ago
- label-smooth, amsoftmax, partial-fc, focal-loss, triplet-loss, lovasz-softmax. Maybe useful☆2,207Updated 3 months ago
- knowledge distillation papers☆743Updated last year
- Flops counter for convolutional networks in pytorch framework☆2,848Updated 3 months ago
- Usable Implementation of "Bootstrap Your Own Latent" self-supervised learning, from Deepmind, in Pytorch☆1,787Updated 6 months ago
- PyTorch implementation of SimSiam https//arxiv.org/abs/2011.10566☆1,173Updated last year
- RepVGG: Making VGG-style ConvNets Great Again☆3,360Updated last year
- Count the MACs / FLOPs of your PyTorch model.☆4,940Updated 6 months ago
- PyTorch implementation of SimCLR: A Simple Framework for Contrastive Learning of Visual Representations☆2,307Updated 10 months ago
- ICCV2021, Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNet☆1,169Updated last year
- Official DeiT repository☆4,114Updated 10 months ago
- [arXiv 2019] "Contrastive Multiview Coding", also contains implementations for MoCo and InstDis☆1,310Updated 4 years ago
- Collect some papers about transformer with vision. Awesome Transformer with Computer Vision (CV)☆3,421Updated last week
- A quickstart and benchmark for pytorch distributed training.☆1,650Updated 5 months ago
- PyTorch implementation of MoCo: https://arxiv.org/abs/1911.05722☆4,855Updated 3 weeks ago
- PyTorch implementation of MoCo v3 https//arxiv.org/abs/2104.02057☆1,235Updated 3 years ago
- This is a collection of our NAS and Vision Transformer work.☆1,707Updated 5 months ago
- PyTorch implementation of "Supervised Contrastive Learning" (and SimCLR incidentally)☆3,172Updated last year
- Classification with PyTorch.☆1,706Updated 7 months ago
- Model analyzer in PyTorch☆1,471Updated last year
- Efficient AI Backbones including GhostNet, TNT and MLP, developed by Huawei Noah's Ark Lab.☆4,115Updated last month