A coding-free framework built on PyTorch for reproducible deep learning studies. PyTorch Ecosystem. π26 knowledge distillation methods presented at TPAMI, CVPR, ICLR, ECCV, NeurIPS, ICCV, AAAI, etc are implemented so far. π Trained models, training logs and configurations are available for ensuring the reproducibiliy and benchmark.
β1,630Aug 28, 2026Updated this week
Alternatives and similar repositories for torchdistill
Users that are interested in torchdistill are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [ICLR 2020] Contrastive Representation Distillation (CRD), and benchmark of recent knowledge distillation methodsβ2,438Oct 16, 2023Updated 2 years ago
- Pytorch implementation of various Knowledge Distillation (KD) methods.β1,759Nov 25, 2021Updated 4 years ago
- A Pytorch Knowledge Distillation library for benchmarking and extending works in the domains of Knowledge Distillation, Pruning, and Quanβ¦β651Mar 1, 2023Updated 3 years ago
- Awesome Knowledge-Distillation. εη±»ζ΄ηηη₯θ―θΈι¦paper(2014-2021)γβ2,686May 30, 2023Updated 3 years ago
- A PyTorch implementation for exploring deep and shallow knowledge distillation (KD) experiments with flexibilityβ2,000Mar 25, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer β’ AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Distilling Knowledge via Knowledge Review, CVPR 2021β275Dec 16, 2022Updated 3 years ago
- Knowledge Distillation: CVPR2020 Oral, Revisiting Knowledge Distillation via Label Smoothing Regularizationβ582Feb 15, 2023Updated 3 years ago
- Official PyTorch implementation of "A Comprehensive Overhaul of Feature Distillation" (ICCV 2019)β422Jun 23, 2020Updated 6 years ago
- The official implementation of [CVPR2022] Decoupled Knowledge Distillation https://arxiv.org/abs/2203.08679 and [ICCV2023] DOT: A Distillβ¦β897Nov 5, 2023Updated 2 years ago
- Awesome Knowledge Distillationβ3,904May 25, 2026Updated 3 months ago
- The largest collection of PyTorch image encoders / backbones. Including train, eval, inference, export scripts, and pretrained weights --β¦β37,107Updated this week
- Official DeiT repositoryβ4,354Mar 15, 2024Updated 2 years ago
- OpenMMLab Model Compression Toolbox and Benchmark.β1,682Jun 11, 2024Updated 2 years ago
- The easiest way to use deep metric learning in your application. Modular, flexible, and extensible. Written in PyTorch.β6,339Aug 17, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways β’ AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- MEAL V2: Boosting Vanilla ResNet-50 to 80%+ Top-1 Accuracy on ImageNet without Tricks. In NeurIPS 2020 workshop.β700Dec 24, 2021Updated 4 years ago
- [CVPR 2023] DepGraph: Towards Any Structural Pruning; LLMs, Vision Foundation Models, etc.β3,348Sep 7, 2025Updated 11 months ago
- VISSL is FAIR's library of extensible, modular and scalable components for SOTA Self-Supervised Learning with images.β3,293Mar 3, 2024Updated 2 years ago
- Codebase for Image Classification Research, written in PyTorch.β2,161Mar 20, 2024Updated 2 years ago
- FFCV: Fast Forward Computer Vision (and other ML workloads!)β2,993Jun 16, 2024Updated 2 years ago
- π Geometric Computer Vision Library for Spatial AIβ11,335Updated this week
- Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pyβ¦β25,491Updated this week
- Code release for ConvNeXt modelβ6,414Jan 8, 2023Updated 3 years ago
- RepVGG: Making VGG-style ConvNets Great Againβ3,478Feb 10, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer β’ AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- PyTorch extensions for high performance and large scale training.β3,407Apr 26, 2025Updated last year
- An end-to-end PyTorch framework for image and video classificationβ1,607Jun 27, 2024Updated 2 years ago
- Mobile vision models and codeβ920Jul 21, 2026Updated last month
- Fast and flexible image augmentation library. Paper about the library: https://www.mdpi.com/2078-2489/11/2/125β15,315Jun 25, 2025Updated last year
- torch-optimizer -- collection of optimizers for Pytorchβ3,171Mar 22, 2024Updated 2 years ago
- A deep learning library for video understanding research.β3,566May 5, 2026Updated 3 months ago
- Localization Distillation for Object Detection (CVPR 2022, TPAMI 2023)β391Oct 24, 2024Updated last year
- Official implementation of paper "Knowledge Distillation from A Stronger Teacher", NeurIPS 2022β158Dec 28, 2022Updated 3 years ago
- Implementation of LambdaNetworks, a new approach to image recognition that reaches SOTA with less computeβ1,529Nov 18, 2020Updated 5 years ago
- Proton VPN Special Offer - Get 70% off β’ AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Flexible and powerful tensor operations for readable and reliable code (for pytorch, jax, TF and others)