yoshitomo-matsubara / torchdistillLinks
A coding-free framework built on PyTorch for reproducible deep learning studies. PyTorch Ecosystem. π25 knowledge distillation methods presented at CVPR, ICLR, ECCV, NeurIPS, ICCV, etc are implemented so far. π Trained models, training logs and configurations are available for ensuring the reproducibiliy and benchmark.
β1,516Updated last month
Alternatives and similar repositories for torchdistill
Users that are interested in torchdistill are comparing it to the libraries listed below
Sorting:
- A Pytorch Knowledge Distillation library for benchmarking and extending works in the domains of Knowledge Distillation, Pruning, and Quanβ¦β634Updated 2 years ago
- Pytorch implementation of various Knowledge Distillation (KD) methods.β1,703Updated 3 years ago
- A PyTorch implementation for exploring deep and shallow knowledge distillation (KD) experiments with flexibilityβ1,945Updated 2 years ago
- SAM: Sharpness-Aware Minimization (PyTorch)β1,886Updated last year
- [ICLR 2020] Contrastive Representation Distillation (CRD), and benchmark of recent knowledge distillation methodsβ2,345Updated last year
- Collection of common code that's shared among different research projects in FAIR computer vision team.β2,138Updated 3 weeks ago
- Awesome Knowledge-Distillation. εη±»ζ΄ηηη₯θ―θΈι¦paper(2014-2021)γβ2,600Updated 2 years ago
- The official implementation of [CVPR2022] Decoupled Knowledge Distillation https://arxiv.org/abs/2203.08679 and [ICCV2023] DOT: A Distillβ¦β861Updated last year
- PoolFormer: MetaFormer Is Actually What You Need for Vision (CVPR 2022 Oral)β1,341Updated last year
- VISSL is FAIR's library of extensible, modular and scalable components for SOTA Self-Supervised Learning with images.β3,284Updated last year
- This is a collection of our NAS and Vision Transformer work.β1,769Updated 10 months ago
- Implementation of ConvMixer for "Patches Are All You Need? π€·"β1,073Updated 2 years ago
- EfficientFormerV2 [ICCV 2023] & EfficientFormer [NeurIPs 2022]β1,054Updated last year
- PyTorch implementation of SimSiam https//arxiv.org/abs/2011.10566β1,196Updated 2 years ago
- A curated list of neural network pruning resources.β2,453Updated last year
- PyTorch implementation of MoCo v3 https//arxiv.org/abs/2104.02057β1,272Updated 3 years ago
- Official DeiT repositoryβ4,216Updated last year
- Usable Implementation of "Bootstrap Your Own Latent" self-supervised learning, from Deepmind, in Pytorchβ1,827Updated 11 months ago
- [CVPR 2021] Official PyTorch implementation for Transformer Interpretability Beyond Attention Visualization, a novel method to visualize β¦β1,897Updated last year
- PyTorch implementation of Contrastive Learning methodsβ1,984Updated last year
- OpenMMLab Model Compression Toolbox and Benchmark.β1,603Updated last year
- Codebase for Image Classification Research, written in PyTorch.β2,154Updated last year
- Code for Noisy Student Training. https://arxiv.org/abs/1911.04252β761Updated 4 years ago
- AugMix: A Simple Data Processing Method to Improve Robustness and Uncertaintyβ989Updated 3 weeks ago
- Count the MACs / FLOPs of your PyTorch model.β5,006Updated 11 months ago
- torch-optimizer -- collection of optimizers for Pytorchβ3,115Updated last year
- Knowledge Distillation: CVPR2020 Oral, Revisiting Knowledge Distillation via Label Smoothing Regularizationβ583Updated 2 years ago
- A general and accurate MACs / FLOPs profiler for PyTorch modelsβ615Updated last year
- Flops counter for neural networks in pytorch frameworkβ2,904Updated 5 months ago
- β600Updated this week