A coding-free framework built on PyTorch for reproducible deep learning studies. PyTorch Ecosystem. π26 knowledge distillation methods presented at TPAMI, CVPR, ICLR, ECCV, NeurIPS, ICCV, AAAI, etc are implemented so far. π Trained models, training logs and configurations are available for ensuring the reproducibiliy and benchmark.
β1,623Jul 12, 2026Updated last week
Alternatives and similar repositories for torchdistill
Users that are interested in torchdistill are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [ICLR 2020] Contrastive Representation Distillation (CRD), and benchmark of recent knowledge distillation methodsβ2,437Oct 16, 2023Updated 2 years ago
- Pytorch implementation of various Knowledge Distillation (KD) methods.β1,751Nov 25, 2021Updated 4 years ago
- A Pytorch Knowledge Distillation library for benchmarking and extending works in the domains of Knowledge Distillation, Pruning, and Quanβ¦β650Mar 1, 2023Updated 3 years ago
- Awesome Knowledge-Distillation. εη±»ζ΄ηηη₯θ―θΈι¦paper(2014-2021)γβ2,676May 30, 2023Updated 3 years ago
- A PyTorch implementation for exploring deep and shallow knowledge distillation (KD) experiments with flexibilityβ1,996Mar 25, 2023Updated 3 years ago
- End-to-end encrypted cloud storage - Proton Drive β’ AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- Distilling Knowledge via Knowledge Review, CVPR 2021β275Dec 16, 2022Updated 3 years ago
- Knowledge Distillation: CVPR2020 Oral, Revisiting Knowledge Distillation via Label Smoothing Regularizationβ582Feb 15, 2023Updated 3 years ago
- Official PyTorch implementation of "A Comprehensive Overhaul of Feature Distillation" (ICCV 2019)β422Jun 23, 2020Updated 6 years ago
- The official implementation of [CVPR2022] Decoupled Knowledge Distillation https://arxiv.org/abs/2203.08679 and [ICCV2023] DOT: A Distillβ¦β898Nov 5, 2023Updated 2 years ago
- Awesome Knowledge Distillationβ3,891May 25, 2026Updated last month
- The largest collection of PyTorch image encoders / backbones. Including train, eval, inference, export scripts, and pretrained weights --β¦β36,993Updated this week
- Official DeiT repositoryβ4,358Mar 15, 2024Updated 2 years ago
- OpenMMLab Model Compression Toolbox and Benchmark.β1,675Jun 11, 2024Updated 2 years ago
- The easiest way to use deep metric learning in your application. Modular, flexible, and extensible. Written in PyTorch.β6,334Aug 17, 2025Updated 11 months ago
- End-to-end encrypted email - Proton Mail β’ AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- MEAL V2: Boosting Vanilla ResNet-50 to 80%+ Top-1 Accuracy on ImageNet without Tricks. In NeurIPS 2020 workshop.β700Dec 24, 2021Updated 4 years ago
- [CVPR 2023] DepGraph: Towards Any Structural Pruning; LLMs, Vision Foundation Models, etc.β3,328Sep 7, 2025Updated 10 months ago
- VISSL is FAIR's library of extensible, modular and scalable components for SOTA Self-Supervised Learning with images.β3,295Mar 3, 2024Updated 2 years ago
- Codebase for Image Classification Research, written in PyTorch.β2,164Mar 20, 2024Updated 2 years ago
- FFCV: Fast Forward Computer Vision (and other ML workloads!)β2,989Jun 16, 2024Updated 2 years ago
- π Geometric Computer Vision Library for Spatial AIβ11,282Updated this week
- Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pyβ¦β25,423Jun 22, 2026Updated 3 weeks ago
- Code release for ConvNeXt modelβ6,415Jan 8, 2023Updated 3 years ago
- RepVGG: Making VGG-style ConvNets Great Againβ3,479Feb 10, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer β’ AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- PyTorch extensions for high performance and large scale training.β3,411Apr 26, 2025Updated last year
- An end-to-end PyTorch framework for image and video classificationβ1,608Jun 27, 2024Updated 2 years ago
- Mobile vision models and codeβ921Jun 17, 2026Updated last month
- torch-optimizer -- collection of optimizers for Pytorchβ3,170Mar 22, 2024Updated 2 years ago
- Fast and flexible image augmentation library. Paper about the library: https://www.mdpi.com/2078-2489/11/2/125β15,318Jun 25, 2025Updated last year
- A deep learning library for video understanding research.β3,565May 5, 2026Updated 2 months ago
- Implementation of LambdaNetworks, a new approach to image recognition that reaches SOTA with less computeβ1,528Nov 18, 2020Updated 5 years ago
- Localization Distillation for Object Detection (CVPR 2022, TPAMI 2023)β391Oct 24, 2024Updated last year
- Official implementation of paper "Knowledge Distillation from A Stronger Teacher", NeurIPS 2022β156Dec 28, 2022Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer β’ AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Flexible and powerful tensor operations for readable and reliable code (for pytorch, jax, TF and others)β9,553Jul 5, 2026Updated 2 weeks ago
- Advanced AI Explainability for computer vision. Support for CNNs, Vision Transformers, Classification, Object detection, Segmentation, Iβ¦β12,919Jul 10, 2026Updated last week
- Collection of common code that's shared among different research projects in FAIR computer vision team.β2,248Jun 2, 2026Updated last month
- knowledge distillation papersβ766Feb 10, 2023Updated 3 years ago
- OpenMMLab Self-Supervised Learning Toolbox and Benchmarkβ3,301Jun 25, 2023Updated 3 years ago
- PoolFormer: MetaFormer Is Actually What You Need for Vision (CVPR 2022 Oral)β1,363Jun 1, 2024Updated 2 years ago
- A GPU-accelerated library containing highly optimized building blocks and an execution engine for data processing to accelerate deep learβ¦β5,728Updated this week