yoshitomo-matsubara / torchdistill
A coding-free framework built on PyTorch for reproducible deep learning studies. PyTorch Ecosystem. π25 knowledge distillation methods presented at CVPR, ICLR, ECCV, NeurIPS, ICCV, etc are implemented so far. π Trained models, training logs and configurations are available for ensuring the reproducibiliy and benchmark.
β1,474Updated last week
Alternatives and similar repositories for torchdistill:
Users that are interested in torchdistill are comparing it to the libraries listed below
- Pytorch implementation of various Knowledge Distillation (KD) methods.β1,677Updated 3 years ago
- A Pytorch Knowledge Distillation library for benchmarking and extending works in the domains of Knowledge Distillation, Pruning, and Quanβ¦β621Updated 2 years ago
- [ICLR 2020] Contrastive Representation Distillation (CRD), and benchmark of recent knowledge distillation methodsβ2,304Updated last year
- Awesome Knowledge-Distillation. εη±»ζ΄ηηη₯θ―θΈι¦paper(2014-2021)γβ2,564Updated last year
- A PyTorch implementation for exploring deep and shallow knowledge distillation (KD) experiments with flexibilityβ1,924Updated 2 years ago
- The official implementation of [CVPR2022] Decoupled Knowledge Distillation https://arxiv.org/abs/2203.08679 and [ICCV2023] DOT: A Distillβ¦β842Updated last year
- Collection of common code that's shared among different research projects in FAIR computer vision team.β2,094Updated 4 months ago
- PyTorch implementation of MoCo v3 https//arxiv.org/abs/2104.02057β1,256Updated 3 years ago
- SAM: Sharpness-Aware Minimization (PyTorch)β1,848Updated last year
- PoolFormer: MetaFormer Is Actually What You Need for Vision (CVPR 2022 Oral)β1,323Updated 10 months ago
- [CVPR 2021] Official PyTorch implementation for Transformer Interpretability Beyond Attention Visualization, a novel method to visualize β¦β1,862Updated last year
- Knowledge Distillation: CVPR2020 Oral, Revisiting Knowledge Distillation via Label Smoothing Regularizationβ586Updated 2 years ago
- This is a collection of our NAS and Vision Transformer work.β1,731Updated 8 months ago
- PyTorch implementation of SimSiam https//arxiv.org/abs/2011.10566β1,184Updated 2 years ago
- EfficientFormerV2 [ICCV 2023] & EfficientFormer [NeurIPs 2022]β1,031Updated last year
- Official DeiT repositoryβ4,165Updated last year
- Explainability for Vision Transformersβ927Updated 3 years ago
- Usable Implementation of "Bootstrap Your Own Latent" self-supervised learning, from Deepmind, in Pytorchβ1,801Updated 8 months ago
- An All-MLP solution for Vision, from Google AIβ1,016Updated 6 months ago
- A list of papers, docs, codes about model quantization. This repo is aimed to provide the info for model quantization research, we are coβ¦β2,043Updated 3 weeks ago
- Codebase for Image Classification Research, written in PyTorch.β2,151Updated last year
- Recent Transformer-based CV and related works.β1,333Updated last year
- A PyTorch-based library for semi-supervised learning (NeurIPS'21)β1,337Updated last year
- (ICLR 2022 Spotlight) Official PyTorch implementation of "How Do Vision Transformers Work?"β812Updated 2 years ago
- Flops counter for neural networks in pytorch frameworkβ2,872Updated 2 months ago
- Code release for ConvNeXt V2 modelβ1,678Updated 7 months ago
- Official Pytorch Implementation of: "ImageNet-21K Pretraining for the Masses"(NeurIPS, 2021) paperβ756Updated 2 years ago
- ICCV2021, Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNetβ1,183Updated last year
- PyTorch implementation of SimCLR: A Simple Framework for Contrastive Learning of Visual Representationsβ2,363Updated last year
- OpenMMLab Self-Supervised Learning Toolbox and Benchmarkβ3,241Updated last year