A coding-free framework built on PyTorch for reproducible deep learning studies. PyTorch Ecosystem. π26 knowledge distillation methods presented at TPAMI, CVPR, ICLR, ECCV, NeurIPS, ICCV, AAAI, etc are implemented so far. π Trained models, training logs and configurations are available for ensuring the reproducibiliy and benchmark.
β1,601Dec 24, 2025Updated 2 months ago
Alternatives and similar repositories for torchdistill
Users that are interested in torchdistill are comparing it to the libraries listed below
Sorting:
- [ICLR 2020] Contrastive Representation Distillation (CRD), and benchmark of recent knowledge distillation methodsβ2,426Oct 16, 2023Updated 2 years ago
- Pytorch implementation of various Knowledge Distillation (KD) methods.β1,745Nov 25, 2021Updated 4 years ago
- A Pytorch Knowledge Distillation library for benchmarking and extending works in the domains of Knowledge Distillation, Pruning, and Quanβ¦β652Mar 1, 2023Updated 3 years ago
- Awesome Knowledge-Distillation. εη±»ζ΄ηηη₯θ―θΈι¦paper(2014-2021)γβ2,655May 30, 2023Updated 2 years ago
- A PyTorch implementation for exploring deep and shallow knowledge distillation (KD) experiments with flexibilityβ1,983Mar 25, 2023Updated 2 years ago
- Distilling Knowledge via Knowledge Review, CVPR 2021β279Dec 16, 2022Updated 3 years ago
- Official PyTorch implementation of "A Comprehensive Overhaul of Feature Distillation" (ICCV 2019)β423Jun 23, 2020Updated 5 years ago
- Knowledge Distillation: CVPR2020 Oral, Revisiting Knowledge Distillation via Label Smoothing Regularizationβ584Feb 15, 2023Updated 3 years ago
- The official implementation of [CVPR2022] Decoupled Knowledge Distillation https://arxiv.org/abs/2203.08679 and [ICCV2023] DOT: A Distillβ¦β894Nov 5, 2023Updated 2 years ago
- Awesome Knowledge Distillationβ3,827Dec 25, 2025Updated 2 months ago
- The largest collection of PyTorch image encoders / backbones. Including train, eval, inference, export scripts, and pretrained weights --β¦β36,504Mar 13, 2026Updated last week
- Official DeiT repositoryβ4,328Mar 15, 2024Updated 2 years ago
- OpenMMLab Model Compression Toolbox and Benchmark.β1,664Jun 11, 2024Updated last year
- The easiest way to use deep metric learning in your application. Modular, flexible, and extensible. Written in PyTorch.β6,315Aug 17, 2025Updated 7 months ago
- MEAL V2: Boosting Vanilla ResNet-50 to 80%+ Top-1 Accuracy on ImageNet without Tricks. In NeurIPS 2020 workshop.β701Dec 24, 2021Updated 4 years ago
- [CVPR 2023] DepGraph: Towards Any Structural Pruning; LLMs, Vision Foundation Models, etc.β3,267Sep 7, 2025Updated 6 months ago
- VISSL is FAIR's library of extensible, modular and scalable components for SOTA Self-Supervised Learning with images.β3,294Mar 3, 2024Updated 2 years ago
- FFCV: Fast Forward Computer Vision (and other ML workloads!)β2,986Jun 16, 2024Updated last year
- Codebase for Image Classification Research, written in PyTorch.β2,166Mar 20, 2024Updated 2 years ago
- π Geometric Computer Vision Library for Spatial AIβ11,121Updated this week
- Code release for ConvNeXt modelβ6,319Jan 8, 2023Updated 3 years ago
- RepVGG: Making VGG-style ConvNets Great Againβ3,464Feb 10, 2023Updated 3 years ago
- PyTorch extensions for high performance and large scale training.β3,403Apr 26, 2025Updated 10 months ago
- Mobile vision models and codeβ918Feb 11, 2026Updated last month
- An end-to-end PyTorch framework for image and video classificationβ1,613Jun 27, 2024Updated last year
- torch-optimizer -- collection of optimizers for Pytorchβ3,166Mar 22, 2024Updated last year
- Official implementation of paper "Knowledge Distillation from A Stronger Teacher", NeurIPS 2022β155Dec 28, 2022Updated 3 years ago
- Fast and flexible image augmentation library. Paper about the library: https://www.mdpi.com/2078-2489/11/2/125β15,275Jun 25, 2025Updated 8 months ago
- A deep learning library for video understanding research.β3,549Jan 12, 2026Updated 2 months ago
- Localization Distillation for Object Detection (CVPR 2022, TPAMI 2023)β388Oct 24, 2024Updated last year
- Flexible and powerful tensor operations for readable and reliable code (for pytorch, jax, TF and others)β9,430Feb 20, 2026Updated last month
- Advanced AI Explainability for computer vision. Support for CNNs, Vision Transformers, Classification, Object detection, Segmentation, Iβ¦β12,682Apr 7, 2025Updated 11 months ago
- Collection of common code that's shared among different research projects in FAIR computer vision team.β2,227Updated this week
- knowledge distillation papersβ768Feb 10, 2023Updated 3 years ago
- PoolFormer: MetaFormer Is Actually What You Need for Vision (CVPR 2022 Oral)β1,366Jun 1, 2024Updated last year
- OpenMMLab Self-Supervised Learning Toolbox and Benchmarkβ3,297Jun 25, 2023Updated 2 years ago
- A GPU-accelerated library containing highly optimized building blocks and an execution engine for data processing to accelerate deep learβ¦β5,642Mar 13, 2026Updated last week
- A curated list of neural network pruning resources.β2,490Apr 4, 2024Updated last year
- [ICLR 2020] Once for All: Train One Network and Specialize it for Efficient Deploymentβ1,943Dec 14, 2023Updated 2 years ago