yoshitomo-matsubara / torchdistillLinks
A coding-free framework built on PyTorch for reproducible deep learning studies. PyTorch Ecosystem. π26 knowledge distillation methods presented at TPAMI, CVPR, ICLR, ECCV, NeurIPS, ICCV, AAAI, etc are implemented so far. π Trained models, training logs and configurations are available for ensuring the reproducibiliy and benchmark.
β1,585Updated last month
Alternatives and similar repositories for torchdistill
Users that are interested in torchdistill are comparing it to the libraries listed below
Sorting:
- Pytorch implementation of various Knowledge Distillation (KD) methods.β1,739Updated 4 years ago
- A Pytorch Knowledge Distillation library for benchmarking and extending works in the domains of Knowledge Distillation, Pruning, and Quanβ¦β652Updated 2 years ago
- [ICLR 2020] Contrastive Representation Distillation (CRD), and benchmark of recent knowledge distillation methodsβ2,426Updated 2 years ago
- A PyTorch implementation for exploring deep and shallow knowledge distillation (KD) experiments with flexibilityβ1,979Updated 2 years ago
- This is a collection of our NAS and Vision Transformer work.β1,824Updated last year
- SAM: Sharpness-Aware Minimization (PyTorch)β1,959Updated last year
- Awesome Knowledge-Distillation. εη±»ζ΄ηηη₯θ―θΈι¦paper(2014-2021)γβ2,651Updated 2 years ago
- The official implementation of [CVPR2022] Decoupled Knowledge Distillation https://arxiv.org/abs/2203.08679 and [ICCV2023] DOT: A Distillβ¦β888Updated 2 years ago
- EfficientFormerV2 [ICCV 2023] & EfficientFormer [NeurIPs 2022]β1,103Updated 2 years ago
- PoolFormer: MetaFormer Is Actually What You Need for Vision (CVPR 2022 Oral)β1,363Updated last year
- A curated list of neural network pruning resources.β2,485Updated last year
- Efficient computing methods developed by Huawei Noah's Ark Labβ1,309Updated last year
- OpenMMLab Model Compression Toolbox and Benchmark.β1,658Updated last year
- Implementation of ConvMixer for "Patches Are All You Need? π€·"β1,082Updated 3 years ago
- Collection of common code that's shared among different research projects in FAIR computer vision team.β2,221Updated 2 weeks ago
- (ICLR 2022 Spotlight) Official PyTorch implementation of "How Do Vision Transformers Work?"β823Updated 3 years ago
- An All-MLP solution for Vision, from Google AIβ1,055Updated 6 months ago
- [CVPR 2023] DepGraph: Towards Any Structural Pruning; LLMs, Vision Foundation Models, etc.β3,249Updated 4 months ago
- CVNets: A library for training computer vision networksβ1,960Updated 2 years ago
- Official Pytorch Implementation of: "ImageNet-21K Pretraining for the Masses"(NeurIPS, 2021) paperβ780Updated 3 years ago
- Codebase for Image Classification Research, written in PyTorch.β2,170Updated last year
- [ICLR 2020] Once for All: Train One Network and Specialize it for Efficient Deploymentβ1,940Updated 2 years ago
- PyTorch implementation of MoCo v3 https//arxiv.org/abs/2104.02057β1,312Updated 4 years ago
- PyTorch implementation of SimSiam https//arxiv.org/abs/2011.10566β1,225Updated 3 years ago
- β619Updated 3 weeks ago
- Knowledge Distillation: CVPR2020 Oral, Revisiting Knowledge Distillation via Label Smoothing Regularizationβ585Updated 2 years ago
- ICCV2021, Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNetβ1,193Updated 2 years ago
- CAIRI Supervised, Semi- and Self-Supervised Visual Representation Learning Toolbox and Benchmarkβ659Updated 3 months ago
- Learning Rate Warmup in PyTorchβ415Updated 7 months ago
- solo-learn: a library of self-supervised methods for visual representation learning powered by Pytorch Lightningβ1,543Updated this week