yoshitomo-matsubara / torchdistill
A coding-free framework built on PyTorch for reproducible deep learning studies. π25 knowledge distillation methods presented at CVPR, ICLR, ECCV, NeurIPS, ICCV, etc are implemented so far. π Trained models, training logs and configurations are available for ensuring the reproducibiliy and benchmark.
β1,392Updated last month
Related projects β
Alternatives and complementary repositories for torchdistill
- A Pytorch Knowledge Distillation library for benchmarking and extending works in the domains of Knowledge Distillation, Pruning, and Quanβ¦β608Updated last year
- Pytorch implementation of various Knowledge Distillation (KD) methods.β1,614Updated 2 years ago
- [ICLR 2020] Contrastive Representation Distillation (CRD), and benchmark of recent knowledge distillation methodsβ2,197Updated last year
- SAM: Sharpness-Aware Minimization (PyTorch)β1,770Updated 9 months ago
- A PyTorch implementation for exploring deep and shallow knowledge distillation (KD) experiments with flexibilityβ1,864Updated last year
- Awesome Knowledge-Distillation. εη±»ζ΄ηηη₯θ―θΈι¦paper(2014-2021)γβ2,497Updated last year
- An All-MLP solution for Vision, from Google AIβ1,003Updated 2 months ago
- PoolFormer: MetaFormer Is Actually What You Need for Vision (CVPR 2022 Oral)β1,295Updated 5 months ago
- The official implementation of [CVPR2022] Decoupled Knowledge Distillation https://arxiv.org/abs/2203.08679 and [ICCV2023] DOT: A Distillβ¦β807Updated last year
- EfficientFormerV2 [ICCV 2023] & EfficientFormer [NeurIPs 2022]β991Updated last year
- PyTorch implementation of MoCo v3 https//arxiv.org/abs/2104.02057β1,218Updated 2 years ago
- This is a collection of our NAS and Vision Transformer work.β1,689Updated 3 months ago
- Knowledge Distillation: CVPR2020 Oral, Revisiting Knowledge Distillation via Label Smoothing Regularizationβ580Updated last year
- PyTorch implementation of SimSiam https//arxiv.org/abs/2011.10566β1,162Updated last year
- CAIRI Supervised, Semi- and Self-Supervised Visual Representation Learning Toolbox and Benchmarkβ629Updated 3 weeks ago
- Flops counter for convolutional networks in pytorch frameworkβ2,822Updated last month
- Collection of common code that's shared among different research projects in FAIR computer vision team.β2,029Updated last month
- (ICLR 2022 Spotlight) Official PyTorch implementation of "How Do Vision Transformers Work?"β806Updated 2 years ago
- OpenMMLab Model Compression Toolbox and Benchmark.β1,479Updated 5 months ago
- Gradually-Warmup Learning Rate Scheduler for PyTorchβ977Updated last month
- Implementation of ConvMixer for "Patches Are All You Need? π€·"β1,062Updated 2 years ago
- Official DeiT repositoryβ4,067Updated 8 months ago
- [CVPR 2021] Official PyTorch implementation for Transformer Interpretability Beyond Attention Visualization, a novel method to visualize β¦β1,798Updated 9 months ago
- PyTorch implementation of Contrastive Learning methodsβ1,942Updated last year
- Usable Implementation of "Bootstrap Your Own Latent" self-supervised learning, from Deepmind, in Pytorchβ1,764Updated 4 months ago
- Pytorch reimplementation of the Vision Transformer (An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale)β1,941Updated 2 years ago
- ICCV2021, Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNetβ1,149Updated last year
- A general and accurate MACs / FLOPs profiler for PyTorch modelsβ571Updated 6 months ago
- mixup: Beyond Empirical Risk Minimizationβ1,168Updated 3 years ago
- VISSL is FAIR's library of extensible, modular and scalable components for SOTA Self-Supervised Learning with images.β3,261Updated 8 months ago