A coding-free framework built on PyTorch for reproducible deep learning studies. PyTorch Ecosystem. π26 knowledge distillation methods presented at TPAMI, CVPR, ICLR, ECCV, NeurIPS, ICCV, AAAI, etc are implemented so far. π Trained models, training logs and configurations are available for ensuring the reproducibiliy and benchmark.
β1,630Aug 28, 2026Updated 2 weeks ago
Alternatives and similar repositories for torchdistill
Users that are interested in torchdistill are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [ICLR 2020] Contrastive Representation Distillation (CRD), and benchmark of recent knowledge distillation methodsβ2,441Oct 16, 2023Updated 2 years ago
- Pytorch implementation of various Knowledge Distillation (KD) methods.β1,761Nov 25, 2021Updated 4 years ago
- A Pytorch Knowledge Distillation library for benchmarking and extending works in the domains of Knowledge Distillation, Pruning, and Quanβ¦β651Mar 1, 2023Updated 3 years ago
- Awesome Knowledge-Distillation. εη±»ζ΄ηηη₯θ―θΈι¦paper(2014-2021)γβ2,690May 30, 2023Updated 3 years ago
- A PyTorch implementation for exploring deep and shallow knowledge distillation (KD) experiments with flexibilityβ2,000Mar 25, 2023Updated 3 years ago
- Proton VPN Special Offer - Get 70% off β’ AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Distilling Knowledge via Knowledge Review, CVPR 2021β275Dec 16, 2022Updated 3 years ago
- Knowledge Distillation: CVPR2020 Oral, Revisiting Knowledge Distillation via Label Smoothing Regularizationβ582Feb 15, 2023Updated 3 years ago
- Official PyTorch implementation of "A Comprehensive Overhaul of Feature Distillation" (ICCV 2019)β422Jun 23, 2020Updated 6 years ago
- The official implementation of [CVPR2022] Decoupled Knowledge Distillation https://arxiv.org/abs/2203.08679 and [ICCV2023] DOT: A Distillβ¦β898Nov 5, 2023Updated 2 years ago
- Awesome Knowledge Distillationβ3,903May 25, 2026Updated 3 months ago
- The largest collection of PyTorch image encoders / backbones. Including train, eval, inference, export scripts, and pretrained weights --β¦β37,144Updated this week
- Official DeiT repositoryβ4,351Mar 15, 2024Updated 2 years ago
- OpenMMLab Model Compression Toolbox and Benchmark.β1,682Jun 11, 2024Updated 2 years ago
- The easiest way to use deep metric learning in your application. Modular, flexible, and extensible. Written in PyTorch.β6,341Aug 17, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer β’ AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- MEAL V2: Boosting Vanilla ResNet-50 to 80%+ Top-1 Accuracy on ImageNet without Tricks. In NeurIPS 2020 workshop.β699Dec 24, 2021Updated 4 years ago
- [CVPR 2023] DepGraph: Towards Any Structural Pruning; LLMs, Vision Foundation Models, etc.β3,357Sep 7, 2025Updated last year
- VISSL is FAIR's library of extensible, modular and scalable components for SOTA Self-Supervised Learning with images.β3,292Mar 3, 2024Updated 2 years ago
- Codebase for Image Classification Research, written in PyTorch.β2,161Mar 20, 2024Updated 2 years ago
- FFCV: Fast Forward Computer Vision (and other ML workloads!)β2,992Jun 16, 2024Updated 2 years ago
- π Geometric Computer Vision Library for Spatial AIβ11,357Updated this week
- Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pyβ¦β25,506Sep 5, 2026Updated last week
- Code release for ConvNeXt modelβ6,412Jan 8, 2023Updated 3 years ago
- RepVGG: Making VGG-style ConvNets Great Againβ3,479Feb 10, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer β’ AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- PyTorch extensions for high performance and large scale training.β3,406Apr 26, 2025Updated last year
- An end-to-end PyTorch framework for image and video classificationβ1,606Jun 27, 2024Updated 2 years ago
- Mobile vision models and codeβ921Jul 21, 2026Updated last month
- Fast and flexible image augmentation library. Paper about the library: https://www.mdpi.com/2078-2489/11/2/125β15,309Jun 25, 2025Updated last year
- torch-optimizer -- collection of optimizers for Pytorchβ3,170Mar 22, 2024Updated 2 years ago
- A deep learning library for video understanding research.β3,564May 5, 2026Updated 4 months ago
- Localization Distillation for Object Detection (CVPR 2022, TPAMI 2023)β391Oct 24, 2024Updated last year
- Implementation of LambdaNetworks, a new approach to image recognition that reaches SOTA with less computeβ1,529Nov 18, 2020Updated 5 years ago
- Official implementation of paper "Knowledge Distillation from A Stronger Teacher", NeurIPS 2022β158Dec 28, 2022Updated 3 years ago
- 1-Click AI Models by DigitalOcean Gradient β’ AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Flexible and powerful tensor operations for readable and reliable code (for pytorch, jax, TF and others)β9,600Aug 26, 2026Updated 3 weeks ago
- Advanced AI Explainability for computer vision. Support for CNNs, Vision Transformers, Classification, Object detection, Segmentation, Iβ¦β12,971Aug 13, 2026Updated last month
- LeViT a Vision Transformer in ConvNet's Clothing for Faster Inferenceβ624Aug 27, 2022Updated 4 years ago
- Collection of common code that's shared among different research projects in FAIR computer vision team.β2,250Aug 19, 2026Updated 3 weeks ago
- knowledge distillation papersβ765Feb 10, 2023Updated 3 years ago
- OpenMMLab Self-Supervised Learning Toolbox and Benchmarkβ3,303Jun 25, 2023Updated 3 years ago
- PoolFormer: MetaFormer Is Actually What You Need for Vision (CVPR 2022 Oral)β1,364Jun 1, 2024Updated 2 years ago