yoshitomo-matsubara / torchdistillLinks
A coding-free framework built on PyTorch for reproducible deep learning studies. PyTorch Ecosystem. π26 knowledge distillation methods presented at CVPR, ICLR, ECCV, NeurIPS, ICCV, etc are implemented so far. π Trained models, training logs and configurations are available for ensuring the reproducibiliy and benchmark.
β1,546Updated last week
Alternatives and similar repositories for torchdistill
Users that are interested in torchdistill are comparing it to the libraries listed below
Sorting:
- Pytorch implementation of various Knowledge Distillation (KD) methods.β1,715Updated 3 years ago
- A Pytorch Knowledge Distillation library for benchmarking and extending works in the domains of Knowledge Distillation, Pruning, and Quanβ¦β641Updated 2 years ago
- A PyTorch implementation for exploring deep and shallow knowledge distillation (KD) experiments with flexibilityβ1,964Updated 2 years ago
- Collection of common code that's shared among different research projects in FAIR computer vision team.β2,168Updated last week
- [ICLR 2020] Contrastive Representation Distillation (CRD), and benchmark of recent knowledge distillation methodsβ2,367Updated last year
- SAM: Sharpness-Aware Minimization (PyTorch)β1,911Updated last year
- This is a collection of our NAS and Vision Transformer work.β1,798Updated last year
- Awesome Knowledge-Distillation. εη±»ζ΄ηηη₯θ―θΈι¦paper(2014-2021)γβ2,624Updated 2 years ago
- The official implementation of [CVPR2022] Decoupled Knowledge Distillation https://arxiv.org/abs/2203.08679 and [ICCV2023] DOT: A Distillβ¦β868Updated last year
- A curated list of neural network pruning resources.β2,475Updated last year
- [CVPR 2023] DepGraph: Towards Any Structural Pruning; LLMs, Vision Foundation Models, etc.β3,122Updated 2 months ago
- EfficientFormerV2 [ICCV 2023] & EfficientFormer [NeurIPs 2022]β1,070Updated 2 years ago
- [ICLR 2020] Once for All: Train One Network and Specialize it for Efficient Deploymentβ1,927Updated last year
- OpenMMLab Model Compression Toolbox and Benchmark.β1,625Updated last year
- Codebase for Image Classification Research, written in PyTorch.β2,161Updated last year
- Efficient computing methods developed by Huawei Noah's Ark Labβ1,292Updated 10 months ago
- PoolFormer: MetaFormer Is Actually What You Need for Vision (CVPR 2022 Oral)β1,350Updated last year
- An All-MLP solution for Vision, from Google AIβ1,037Updated last month
- Implementation of ConvMixer for "Patches Are All You Need? π€·"β1,077Updated 2 years ago
- Flops counter for neural networks in pytorch frameworkβ2,932Updated 2 weeks ago
- Escaping the Big Data Paradigm with Compact Transformers, 2021 (Train your Vision Transformers in 30 mins on CIFAR-10 with a single GPU!)β535Updated 10 months ago
- This is a collection of our zero-cost NAS and efficient vision applications.β429Updated 2 years ago
- VISSL is FAIR's library of extensible, modular and scalable components for SOTA Self-Supervised Learning with images.β3,284Updated last year
- β605Updated last week
- Code release for ConvNeXt V2 modelβ1,820Updated last year
- PyTorch implementation of SimSiam https//arxiv.org/abs/2011.10566β1,210Updated 2 years ago
- solo-learn: a library of self-supervised methods for visual representation learning powered by Pytorch Lightningβ1,507Updated 3 weeks ago
- Knowledge Distillation: CVPR2020 Oral, Revisiting Knowledge Distillation via Label Smoothing Regularizationβ584Updated 2 years ago
- (ICLR 2022 Spotlight) Official PyTorch implementation of "How Do Vision Transformers Work?"β820Updated 3 years ago
- ICCV2021, Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNetβ1,191Updated last year