A coding-free framework built on PyTorch for reproducible deep learning studies. PyTorch Ecosystem. π26 knowledge distillation methods presented at TPAMI, CVPR, ICLR, ECCV, NeurIPS, ICCV, AAAI, etc are implemented so far. π Trained models, training logs and configurations are available for ensuring the reproducibiliy and benchmark.
β1,607Mar 31, 2026Updated last week
Alternatives and similar repositories for torchdistill
Users that are interested in torchdistill are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [ICLR 2020] Contrastive Representation Distillation (CRD), and benchmark of recent knowledge distillation methodsβ2,427Oct 16, 2023Updated 2 years ago
- Pytorch implementation of various Knowledge Distillation (KD) methods.β1,745Nov 25, 2021Updated 4 years ago
- A Pytorch Knowledge Distillation library for benchmarking and extending works in the domains of Knowledge Distillation, Pruning, and Quanβ¦β651Mar 1, 2023Updated 3 years ago
- Awesome Knowledge-Distillation. εη±»ζ΄ηηη₯θ―θΈι¦paper(2014-2021)γβ2,657May 30, 2023Updated 2 years ago
- A PyTorch implementation for exploring deep and shallow knowledge distillation (KD) experiments with flexibilityβ1,982Mar 25, 2023Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways β’ AdManaged hosting with the flexibility to host WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Cloudways by DigitalOcean.
- Distilling Knowledge via Knowledge Review, CVPR 2021β278Dec 16, 2022Updated 3 years ago
- Official PyTorch implementation of "A Comprehensive Overhaul of Feature Distillation" (ICCV 2019)β423Jun 23, 2020Updated 5 years ago
- Knowledge Distillation: CVPR2020 Oral, Revisiting Knowledge Distillation via Label Smoothing Regularizationβ584Feb 15, 2023Updated 3 years ago
- The official implementation of [CVPR2022] Decoupled Knowledge Distillation https://arxiv.org/abs/2203.08679 and [ICCV2023] DOT: A Distillβ¦β896Nov 5, 2023Updated 2 years ago
- Awesome Knowledge Distillationβ3,834Mar 22, 2026Updated 2 weeks ago
- The largest collection of PyTorch image encoders / backbones. Including train, eval, inference, export scripts, and pretrained weights --β¦β36,603Apr 3, 2026Updated last week
- Official DeiT repositoryβ4,328Mar 15, 2024Updated 2 years ago
- OpenMMLab Model Compression Toolbox and Benchmark.β1,667Jun 11, 2024Updated last year
- The easiest way to use deep metric learning in your application. Modular, flexible, and extensible. Written in PyTorch.β6,311Aug 17, 2025Updated 7 months ago
- Managed hosting for WordPress and PHP on Cloudways β’ AdManaged hosting with the flexibility to host WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Cloudways by DigitalOcean.
- MEAL V2: Boosting Vanilla ResNet-50 to 80%+ Top-1 Accuracy on ImageNet without Tricks. In NeurIPS 2020 workshop.β701Dec 24, 2021Updated 4 years ago
- [CVPR 2023] DepGraph: Towards Any Structural Pruning; LLMs, Vision Foundation Models, etc.β3,278Sep 7, 2025Updated 7 months ago
- VISSL is FAIR's library of extensible, modular and scalable components for SOTA Self-Supervised Learning with images.β3,295Mar 3, 2024Updated 2 years ago
- FFCV: Fast Forward Computer Vision (and other ML workloads!)β2,988Jun 16, 2024Updated last year
- Codebase for Image Classification Research, written in PyTorch.β2,167Mar 20, 2024Updated 2 years ago
- π Geometric Computer Vision Library for Spatial AIβ11,160Updated this week
- Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pyβ¦β25,023Updated this week
- Code release for ConvNeXt modelβ6,347Jan 8, 2023Updated 3 years ago
- RepVGG: Making VGG-style ConvNets Great Againβ3,471Feb 10, 2023Updated 3 years ago
- DigitalOcean Gradient AI Platform β’ AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- PyTorch extensions for high performance and large scale training.β3,404Apr 26, 2025Updated 11 months ago
- Mobile vision models and codeβ920Feb 11, 2026Updated last month
- An end-to-end PyTorch framework for image and video classificationβ1,614Jun 27, 2024Updated last year
- torch-optimizer -- collection of optimizers for Pytorchβ3,169Mar 22, 2024Updated 2 years ago
- Official implementation of paper "Knowledge Distillation from A Stronger Teacher", NeurIPS 2022β156Dec 28, 2022Updated 3 years ago
- Fast and flexible image augmentation library. Paper about the library: https://www.mdpi.com/2078-2489/11/2/125β15,292Jun 25, 2025Updated 9 months ago
- A deep learning library for video understanding research.β3,554Jan 12, 2026Updated 2 months ago
- Implementation of LambdaNetworks, a new approach to image recognition that reaches SOTA with less computeβ1,531Nov 18, 2020Updated 5 years ago
- Localization Distillation for Object Detection (CVPR 2022, TPAMI 2023)β389Oct 24, 2024Updated last year
- DigitalOcean Gradient AI Platform β’ AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Flexible and powerful tensor operations for readable and reliable code (for pytorch, jax, TF and others)β9,450Feb 20, 2026Updated last month
- Advanced AI Explainability for computer vision. Support for CNNs, Vision Transformers, Classification, Object detection, Segmentation, Iβ¦β12,722Mar 29, 2026Updated last week
- Collection of common code that's shared among different research projects in FAIR computer vision team.β2,233Mar 15, 2026Updated 3 weeks ago
- knowledge distillation papersβ765Feb 10, 2023Updated 3 years ago
- OpenMMLab Self-Supervised Learning Toolbox and Benchmarkβ3,300Jun 25, 2023Updated 2 years ago
- PoolFormer: MetaFormer Is Actually What You Need for Vision (CVPR 2022 Oral)β1,366Jun 1, 2024Updated last year
- A GPU-accelerated library containing highly optimized building blocks and an execution engine for data processing to accelerate deep learβ¦β5,658Apr 2, 2026Updated last week