yoshitomo-matsubara / torchdistillView external linksLinks
A coding-free framework built on PyTorch for reproducible deep learning studies. PyTorch Ecosystem. π26 knowledge distillation methods presented at TPAMI, CVPR, ICLR, ECCV, NeurIPS, ICCV, AAAI, etc are implemented so far. π Trained models, training logs and configurations are available for ensuring the reproducibiliy and benchmark.
β1,590Dec 24, 2025Updated last month
Alternatives and similar repositories for torchdistill
Users that are interested in torchdistill are comparing it to the libraries listed below
Sorting:
- [ICLR 2020] Contrastive Representation Distillation (CRD), and benchmark of recent knowledge distillation methodsβ2,426Oct 16, 2023Updated 2 years ago
- Pytorch implementation of various Knowledge Distillation (KD) methods.β1,742Nov 25, 2021Updated 4 years ago
- A Pytorch Knowledge Distillation library for benchmarking and extending works in the domains of Knowledge Distillation, Pruning, and Quanβ¦β653Mar 1, 2023Updated 2 years ago
- Awesome Knowledge-Distillation. εη±»ζ΄ηηη₯θ―θΈι¦paper(2014-2021)γβ2,654May 30, 2023Updated 2 years ago
- A PyTorch implementation for exploring deep and shallow knowledge distillation (KD) experiments with flexibilityβ1,978Mar 25, 2023Updated 2 years ago
- Official DeiT repositoryβ4,322Mar 15, 2024Updated last year
- Official PyTorch implementation of "A Comprehensive Overhaul of Feature Distillation" (ICCV 2019)β423Jun 23, 2020Updated 5 years ago
- Knowledge Distillation: CVPR2020 Oral, Revisiting Knowledge Distillation via Label Smoothing Regularizationβ585Feb 15, 2023Updated 3 years ago
- The largest collection of PyTorch image encoders / backbones. Including train, eval, inference, export scripts, and pretrained weights --β¦β36,351Updated this week
- Distilling Knowledge via Knowledge Review, CVPR 2021β280Dec 16, 2022Updated 3 years ago
- OpenMMLab Model Compression Toolbox and Benchmark.β1,661Jun 11, 2024Updated last year
- MEAL V2: Boosting Vanilla ResNet-50 to 80%+ Top-1 Accuracy on ImageNet without Tricks. In NeurIPS 2020 workshop.β700Dec 24, 2021Updated 4 years ago
- The easiest way to use deep metric learning in your application. Modular, flexible, and extensible. Written in PyTorch.β6,304Aug 17, 2025Updated 6 months ago
- FFCV: Fast Forward Computer Vision (and other ML workloads!)β2,989Jun 16, 2024Updated last year
- Awesome Knowledge Distillationβ3,811Dec 25, 2025Updated last month
- VISSL is FAIR's library of extensible, modular and scalable components for SOTA Self-Supervised Learning with images.β3,293Mar 3, 2024Updated last year
- The official implementation of [CVPR2022] Decoupled Knowledge Distillation https://arxiv.org/abs/2203.08679 and [ICCV2023] DOT: A Distillβ¦β889Nov 5, 2023Updated 2 years ago
- Codebase for Image Classification Research, written in PyTorch.β2,169Mar 20, 2024Updated last year
- [CVPR 2023] DepGraph: Towards Any Structural Pruning; LLMs, Vision Foundation Models, etc.β3,255Sep 7, 2025Updated 5 months ago
- π Geometric Computer Vision Library for Spatial AIβ11,071Feb 9, 2026Updated last week
- Code release for ConvNeXt modelβ6,292Jan 8, 2023Updated 3 years ago
- Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pyβ¦β24,993Updated this week
- An end-to-end PyTorch framework for image and video classificationβ1,612Jun 27, 2024Updated last year
- torch-optimizer -- collection of optimizers for Pytorchβ3,162Mar 22, 2024Updated last year
- PyTorch extensions for high performance and large scale training.β3,397Apr 26, 2025Updated 9 months ago
- A deep learning library for video understanding research.β3,543Jan 12, 2026Updated last month
- Mobile vision models and codeβ916Updated this week
- RepVGG: Making VGG-style ConvNets Great Againβ3,453Feb 10, 2023Updated 3 years ago
- Flexible and powerful tensor operations for readable and reliable code (for pytorch, jax, TF and others)β9,395Jan 26, 2026Updated 3 weeks ago
- Fast and flexible image augmentation library. Paper about the library: https://www.mdpi.com/2078-2489/11/2/125β15,266Jun 25, 2025Updated 7 months ago
- Collection of common code that's shared among different research projects in FAIR computer vision team.β2,224Jan 12, 2026Updated last month
- Code release for "Detecting Twenty-thousand Classes using Image-level Supervision".β1,997Mar 21, 2024Updated last year
- Official Implementation of 'Fast AutoAugment' in PyTorch.β1,614Jun 16, 2021Updated 4 years ago
- [ICLR 2020] Once for All: Train One Network and Specialize it for Efficient Deploymentβ1,939Dec 14, 2023Updated 2 years ago
- A GPU-accelerated library containing highly optimized building blocks and an execution engine for data processing to accelerate deep learβ¦β5,625Updated this week
- OpenMMLab Self-Supervised Learning Toolbox and Benchmarkβ3,297Jun 25, 2023Updated 2 years ago
- Implementation of Online Label Smoothing in PyTorchβ96Sep 27, 2022Updated 3 years ago
- PoolFormer: MetaFormer Is Actually What You Need for Vision (CVPR 2022 Oral)β1,365Jun 1, 2024Updated last year
- PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRTβ2,944Feb 10, 2026Updated last week