A coding-free framework built on PyTorch for reproducible deep learning studies. PyTorch Ecosystem. π28 knowledge distillation methods presented at TPAMI, CVPR, ICLR, ECCV, NeurIPS, ICCV, AAAI, etc are implemented so far. π Trained models, training logs and configurations are available for ensuring the reproducibiliy and benchmark.
β1,637Nov 12, 2026Updated last week
Alternatives and similar repositories for torchdistill
Users that are interested in torchdistill are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [ICLR 2020] Contrastive Representation Distillation (CRD), and benchmark of recent knowledge distillation methodsβ2,448Oct 16, 2023Updated 3 years ago
- Pytorch implementation of various Knowledge Distillation (KD) methods.β1,764Nov 25, 2021Updated 4 years ago
- A Pytorch Knowledge Distillation library for benchmarking and extending works in the domains of Knowledge Distillation, Pruning, and Quanβ¦β652Mar 1, 2023Updated 3 years ago
- Awesome Knowledge-Distillation. εη±»ζ΄ηηη₯θ―θΈι¦paper(2014-2021)γβ2,698May 30, 2023Updated 3 years ago
- A PyTorch implementation for exploring deep and shallow knowledge distillation (KD) experiments with flexibilityβ2,000Mar 25, 2023Updated 3 years ago
- Managed Kubernetes at scale on DigitalOcean β’ AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Distilling Knowledge via Knowledge Review, CVPR 2021β277Dec 16, 2022Updated 3 years ago
- Awesome Knowledge Distillationβ3,920Oct 26, 2026Updated 3 weeks ago
- Official PyTorch implementation of "A Comprehensive Overhaul of Feature Distillation" (ICCV 2019)β421Jun 23, 2020Updated 6 years ago
- The official implementation of [CVPR2022] Decoupled Knowledge Distillation https://arxiv.org/abs/2203.08679 and [ICCV2023] DOT: A Distillβ¦β899Nov 5, 2023Updated 3 years ago
- The largest collection of PyTorch image encoders / backbones. Including train, eval, inference, export scripts, and pretrained weights --β¦β37,289Updated this week
- Knowledge Distillation: CVPR2020 Oral, Revisiting Knowledge Distillation via Label Smoothing Regularizationβ582Feb 15, 2023Updated 3 years ago
- OpenMMLab Model Compression Toolbox and Benchmark.β1,692Jun 11, 2024Updated 2 years ago
- Train and evaluate embeddings for similarity search with PyTorch. Includes contrastive losses, hard example mining, samplers, and retrievβ¦β6,343Updated this week
- Official DeiT repositoryβ4,346Mar 15, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer β’ AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- MEAL V2: Boosting Vanilla ResNet-50 to 80%+ Top-1 Accuracy on ImageNet without Tricks. In NeurIPS 2020 workshop.β698Dec 24, 2021Updated 4 years ago
- [CVPR 2023] DepGraph: Towards Any Structural Pruning; LLMs, Vision Foundation Models, etc.β3,372Updated this week
- VISSL is FAIR's library of extensible, modular and scalable components for SOTA Self-Supervised Learning with images.β3,288Mar 3, 2024Updated 2 years ago
- FFCV: Fast Forward Computer Vision (and other ML workloads!)β2,995Jun 16, 2024Updated 2 years ago
- Codebase for Image Classification Research, written in PyTorch.β2,161Mar 20, 2024Updated 2 years ago
- π Geometric Computer Vision Library for Spatial AIβ12,392Updated this week
- Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pyβ¦β25,581Nov 7, 2026Updated last week
- RepVGG: Making VGG-style ConvNets Great Againβ3,474Feb 10, 2023Updated 3 years ago
- Code release for ConvNeXt modelβ6,410Jan 8, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer β’ AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- An end-to-end PyTorch framework for image and video classificationβ1,605Jun 27, 2024Updated 2 years ago
- PyTorch extensions for high performance and large scale training.β3,404Apr 26, 2025Updated last year
- Fast and flexible image augmentation library. Paper about the library: https://www.mdpi.com/2078-2489/11/2/125β15,296Jun 25, 2025Updated last year
- Mobile vision models and codeβ923Oct 21, 2026Updated 3 weeks ago
- A deep learning library for video understanding research.β3,569Oct 16, 2026Updated last month
- Localization Distillation for Object Detection (CVPR 2022, TPAMI 2023)β393Oct 24, 2024Updated 2 years ago
- torch-optimizer -- collection of optimizers for Pytorchβ3,172Mar 22, 2024Updated 2 years ago
- Official implementation of paper "Knowledge Distillation from A Stronger Teacher", NeurIPS 2022β158Dec 28, 2022Updated 3 years ago
- Flexible and powerful tensor operations for readable and reliable code (for pytorch, jax, TF and others)β9,638Aug 26, 2026Updated 2 months ago
- Deploy on Railway without the complexity - Free Credits Offer β’ AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Implementation of LambdaNetworks, a new approach to image recognition that reaches SOTA with less computeβ1,530Nov 18, 2020Updated 6 years ago
- knowledge distillation papersβ766Feb 10, 2023Updated 3 years ago
- A GPU-accelerated library containing highly optimized building blocks and an execution engine for data processing to accelerate deep learβ¦β5,796Updated this week
- Advanced AI Explainability for computer vision. Support for CNNs, Vision Transformers, Classification, Object detection, Segmentation, Iβ¦β13,014Nov 1, 2026Updated 2 weeks ago
- LeViT a Vision Transformer in ConvNet's Clothing for Faster Inferenceβ622Aug 27, 2022Updated 4 years ago
- π A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (iβ¦β9,951Updated this week
- A curated list of neural network pruning resources.β2,497Apr 4, 2024Updated 2 years ago
Are these results useful?