yoshitomo-matsubara / torchdistillLinks
A coding-free framework built on PyTorch for reproducible deep learning studies. PyTorch Ecosystem. π26 knowledge distillation methods presented at TPAMI, CVPR, ICLR, ECCV, NeurIPS, ICCV, AAAI, etc are implemented so far. π Trained models, training logs and configurations are available for ensuring the reproducibiliy and benchmark.
β1,581Updated 2 weeks ago
Alternatives and similar repositories for torchdistill
Users that are interested in torchdistill are comparing it to the libraries listed below
Sorting:
- A Pytorch Knowledge Distillation library for benchmarking and extending works in the domains of Knowledge Distillation, Pruning, and Quanβ¦β653Updated 2 years ago
- Pytorch implementation of various Knowledge Distillation (KD) methods.β1,737Updated 4 years ago
- [ICLR 2020] Contrastive Representation Distillation (CRD), and benchmark of recent knowledge distillation methodsβ2,421Updated 2 years ago
- A PyTorch implementation for exploring deep and shallow knowledge distillation (KD) experiments with flexibilityβ1,977Updated 2 years ago
- SAM: Sharpness-Aware Minimization (PyTorch)β1,955Updated last year
- This is a collection of our NAS and Vision Transformer work.β1,820Updated last year
- Awesome Knowledge-Distillation. εη±»ζ΄ηηη₯θ―θΈι¦paper(2014-2021)γβ2,647Updated 2 years ago
- The official implementation of [CVPR2022] Decoupled Knowledge Distillation https://arxiv.org/abs/2203.08679 and [ICCV2023] DOT: A Distillβ¦β885Updated 2 years ago
- Collection of common code that's shared among different research projects in FAIR computer vision team.β2,208Updated 4 months ago
- A curated list of neural network pruning resources.β2,488Updated last year
- Implementation of ConvMixer for "Patches Are All You Need? π€·"β1,078Updated 3 years ago
- EfficientFormerV2 [ICCV 2023] & EfficientFormer [NeurIPs 2022]β1,101Updated 2 years ago
- CAIRI Supervised, Semi- and Self-Supervised Visual Representation Learning Toolbox and Benchmarkβ658Updated 2 months ago
- Escaping the Big Data Paradigm with Compact Transformers, 2021 (Train your Vision Transformers in 30 mins on CIFAR-10 with a single GPU!)β539Updated last year
- OpenMMLab Model Compression Toolbox and Benchmark.β1,655Updated last year
- Official Pytorch Implementation of: "ImageNet-21K Pretraining for the Masses"(NeurIPS, 2021) paperβ778Updated 2 years ago
- [CVPR 2023] DepGraph: Towards Any Structural Pruning; LLMs, Vision Foundation Models, etc.β3,235Updated 4 months ago
- Efficient computing methods developed by Huawei Noah's Ark Labβ1,307Updated last year
- PyTorch implementation of MoCo v3 https//arxiv.org/abs/2104.02057β1,307Updated 4 years ago
- PoolFormer: MetaFormer Is Actually What You Need for Vision (CVPR 2022 Oral)β1,359Updated last year
- solo-learn: a library of self-supervised methods for visual representation learning powered by Pytorch Lightningβ1,538Updated last month
- A PyTorch-based library for semi-supervised learning (NeurIPS'21)β1,366Updated 2 years ago
- An All-MLP solution for Vision, from Google AIβ1,054Updated 6 months ago
- [ICLR 2020] Once for All: Train One Network and Specialize it for Efficient Deploymentβ1,940Updated 2 years ago
- Flops counter for neural networks in pytorch frameworkβ2,962Updated 4 months ago
- PyTorch implementation of SimSiam https//arxiv.org/abs/2011.10566β1,223Updated 2 years ago
- CVNets: A library for training computer vision networksβ1,946Updated 2 years ago
- Knowledge Distillation: CVPR2020 Oral, Revisiting Knowledge Distillation via Label Smoothing Regularizationβ585Updated 2 years ago
- β616Updated this week
- Official DeiT repositoryβ4,310Updated last year