yoshitomo-matsubara / torchdistill
A coding-free framework built on PyTorch for reproducible deep learning studies. PyTorch Ecosystem. π25 knowledge distillation methods presented at CVPR, ICLR, ECCV, NeurIPS, ICCV, etc are implemented so far. π Trained models, training logs and configurations are available for ensuring the reproducibiliy and benchmark.
β1,488Updated last month
Alternatives and similar repositories for torchdistill:
Users that are interested in torchdistill are comparing it to the libraries listed below
- A Pytorch Knowledge Distillation library for benchmarking and extending works in the domains of Knowledge Distillation, Pruning, and Quanβ¦β624Updated 2 years ago
- Pytorch implementation of various Knowledge Distillation (KD) methods.β1,683Updated 3 years ago
- A PyTorch implementation for exploring deep and shallow knowledge distillation (KD) experiments with flexibilityβ1,927Updated 2 years ago
- Awesome Knowledge-Distillation. εη±»ζ΄ηηη₯θ―θΈι¦paper(2014-2021)γβ2,573Updated last year
- [ICLR 2020] Contrastive Representation Distillation (CRD), and benchmark of recent knowledge distillation methodsβ2,316Updated last year
- The official implementation of [CVPR2022] Decoupled Knowledge Distillation https://arxiv.org/abs/2203.08679 and [ICCV2023] DOT: A Distillβ¦β849Updated last year
- Knowledge Distillation: CVPR2020 Oral, Revisiting Knowledge Distillation via Label Smoothing Regularizationβ587Updated 2 years ago
- A curated list of neural network pruning resources.β2,437Updated last year
- Collection of common code that's shared among different research projects in FAIR computer vision team.β2,112Updated 4 months ago
- Awesome Knowledge Distillationβ3,648Updated last month
- SAM: Sharpness-Aware Minimization (PyTorch)β1,864Updated last year
- PyTorch implementation of Contrastive Learning methodsβ1,975Updated last year
- CAIRI Supervised, Semi- and Self-Supervised Visual Representation Learning Toolbox and Benchmarkβ648Updated 2 weeks ago
- OpenMMLab Model Compression Toolbox and Benchmark.β1,580Updated 10 months ago
- knowledge distillation papersβ753Updated 2 years ago
- [CVPR 2023] DepGraph: Towards Any Structural Pruningβ2,980Updated last week
- This is a collection of our NAS and Vision Transformer work.β1,745Updated 9 months ago
- Learning Rate Warmup in PyTorchβ409Updated last month
- PoolFormer: MetaFormer Is Actually What You Need for Vision (CVPR 2022 Oral)β1,324Updated 10 months ago
- Code for Noisy Student Training. https://arxiv.org/abs/1911.04252β760Updated 4 years ago
- Flops counter for neural networks in pytorch frameworkβ2,886Updated 3 months ago
- [CVPR 2021] Official PyTorch implementation for Transformer Interpretability Beyond Attention Visualization, a novel method to visualize β¦β1,875Updated last year
- An All-MLP solution for Vision, from Google AIβ1,019Updated 7 months ago
- PyTorch implementation of SwAV https//arxiv.org/abs/2006.09882β2,036Updated 2 years ago
- EfficientFormerV2 [ICCV 2023] & EfficientFormer [NeurIPs 2022]β1,037Updated last year
- VISSL is FAIR's library of extensible, modular and scalable components for SOTA Self-Supervised Learning with images.β3,279Updated last year
- TorchMultimodal is a PyTorch library for training state-of-the-art multimodal multi-task models at scale.β1,579Updated last week
- Codebase for Image Classification Research, written in PyTorch.β2,154Updated last year
- Recent Transformer-based CV and related works.β1,332Updated last year
- solo-learn: a library of self-supervised methods for visual representation learning powered by Pytorch Lightningβ1,475Updated 2 weeks ago