A coding-free framework built on PyTorch for reproducible deep learning studies. PyTorch Ecosystem. π26 knowledge distillation methods presented at TPAMI, CVPR, ICLR, ECCV, NeurIPS, ICCV, AAAI, etc are implemented so far. π Trained models, training logs and configurations are available for ensuring the reproducibiliy and benchmark.
β1,596Dec 24, 2025Updated 2 months ago
Alternatives and similar repositories for torchdistill
Users that are interested in torchdistill are comparing it to the libraries listed below
Sorting:
- [ICLR 2020] Contrastive Representation Distillation (CRD), and benchmark of recent knowledge distillation methodsβ2,426Oct 16, 2023Updated 2 years ago
- Pytorch implementation of various Knowledge Distillation (KD) methods.β1,743Nov 25, 2021Updated 4 years ago
- A Pytorch Knowledge Distillation library for benchmarking and extending works in the domains of Knowledge Distillation, Pruning, and Quanβ¦β652Mar 1, 2023Updated 3 years ago
- Awesome Knowledge-Distillation. εη±»ζ΄ηηη₯θ―θΈι¦paper(2014-2021)γβ2,654May 30, 2023Updated 2 years ago
- A PyTorch implementation for exploring deep and shallow knowledge distillation (KD) experiments with flexibilityβ1,983Mar 25, 2023Updated 2 years ago
- Official DeiT repositoryβ4,326Mar 15, 2024Updated last year
- Official PyTorch implementation of "A Comprehensive Overhaul of Feature Distillation" (ICCV 2019)β423Jun 23, 2020Updated 5 years ago
- Knowledge Distillation: CVPR2020 Oral, Revisiting Knowledge Distillation via Label Smoothing Regularizationβ584Feb 15, 2023Updated 3 years ago
- The largest collection of PyTorch image encoders / backbones. Including train, eval, inference, export scripts, and pretrained weights --β¦β36,461Updated this week
- Distilling Knowledge via Knowledge Review, CVPR 2021β279Dec 16, 2022Updated 3 years ago
- OpenMMLab Model Compression Toolbox and Benchmark.β1,662Jun 11, 2024Updated last year
- MEAL V2: Boosting Vanilla ResNet-50 to 80%+ Top-1 Accuracy on ImageNet without Tricks. In NeurIPS 2020 workshop.β701Dec 24, 2021Updated 4 years ago
- The easiest way to use deep metric learning in your application. Modular, flexible, and extensible. Written in PyTorch.β6,311Aug 17, 2025Updated 6 months ago
- FFCV: Fast Forward Computer Vision (and other ML workloads!)β2,987Jun 16, 2024Updated last year
- Awesome Knowledge Distillationβ3,820Dec 25, 2025Updated 2 months ago
- VISSL is FAIR's library of extensible, modular and scalable components for SOTA Self-Supervised Learning with images.β3,294Mar 3, 2024Updated 2 years ago
- The official implementation of [CVPR2022] Decoupled Knowledge Distillation https://arxiv.org/abs/2203.08679 and [ICCV2023] DOT: A Distillβ¦β892Nov 5, 2023Updated 2 years ago
- Codebase for Image Classification Research, written in PyTorch.β2,167Mar 20, 2024Updated last year
- [CVPR 2023] DepGraph: Towards Any Structural Pruning; LLMs, Vision Foundation Models, etc.β3,264Sep 7, 2025Updated 6 months ago
- π Geometric Computer Vision Library for Spatial AIβ11,104Mar 2, 2026Updated last week
- Code release for ConvNeXt modelβ6,302Jan 8, 2023Updated 3 years ago
- An end-to-end PyTorch framework for image and video classificationβ1,613Jun 27, 2024Updated last year
- torch-optimizer -- collection of optimizers for Pytorchβ3,163Mar 22, 2024Updated last year
- PyTorch extensions for high performance and large scale training.β3,400Apr 26, 2025Updated 10 months ago
- A deep learning library for video understanding research.β3,546Jan 12, 2026Updated last month
- Mobile vision models and codeβ918Feb 11, 2026Updated 3 weeks ago
- RepVGG: Making VGG-style ConvNets Great Againβ3,459Feb 10, 2023Updated 3 years ago
- Flexible and powerful tensor operations for readable and reliable code (for pytorch, jax, TF and others)β9,415Feb 20, 2026Updated 2 weeks ago
- Fast and flexible image augmentation library. Paper about the library: https://www.mdpi.com/2078-2489/11/2/125β15,268Jun 25, 2025Updated 8 months ago
- Collection of common code that's shared among different research projects in FAIR computer vision team.β2,225Feb 25, 2026Updated last week
- Code release for "Detecting Twenty-thousand Classes using Image-level Supervision".β1,998Mar 21, 2024Updated last year
- Official Implementation of 'Fast AutoAugment' in PyTorch.β1,612Jun 16, 2021Updated 4 years ago
- [ICLR 2020] Once for All: Train One Network and Specialize it for Efficient Deploymentβ1,940Dec 14, 2023Updated 2 years ago
- A GPU-accelerated library containing highly optimized building blocks and an execution engine for data processing to accelerate deep learβ¦β5,642Updated this week
- OpenMMLab Self-Supervised Learning Toolbox and Benchmarkβ3,296Jun 25, 2023Updated 2 years ago
- Implementation of Online Label Smoothing in PyTorchβ96Sep 27, 2022Updated 3 years ago
- PoolFormer: MetaFormer Is Actually What You Need for Vision (CVPR 2022 Oral)β1,367Jun 1, 2024Updated last year
- PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRTβ2,956Updated this week
- π A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (iβ¦β9,528Updated this week