yoshitomo-matsubara / torchdistillLinks
A coding-free framework built on PyTorch for reproducible deep learning studies. PyTorch Ecosystem. π26 knowledge distillation methods presented at CVPR, ICLR, ECCV, NeurIPS, ICCV, etc are implemented so far. π Trained models, training logs and configurations are available for ensuring the reproducibiliy and benchmark.
β1,574Updated last month
Alternatives and similar repositories for torchdistill
Users that are interested in torchdistill are comparing it to the libraries listed below
Sorting:
- Pytorch implementation of various Knowledge Distillation (KD) methods.β1,734Updated 4 years ago
- A Pytorch Knowledge Distillation library for benchmarking and extending works in the domains of Knowledge Distillation, Pruning, and Quanβ¦β650Updated 2 years ago
- [ICLR 2020] Contrastive Representation Distillation (CRD), and benchmark of recent knowledge distillation methodsβ2,414Updated 2 years ago
- This is a collection of our NAS and Vision Transformer work.β1,812Updated last year
- A PyTorch implementation for exploring deep and shallow knowledge distillation (KD) experiments with flexibilityβ1,973Updated 2 years ago
- Awesome Knowledge-Distillation. εη±»ζ΄ηηη₯θ―θΈι¦paper(2014-2021)γβ2,642Updated 2 years ago
- EfficientFormerV2 [ICCV 2023] & EfficientFormer [NeurIPs 2022]β1,095Updated 2 years ago
- PoolFormer: MetaFormer Is Actually What You Need for Vision (CVPR 2022 Oral)β1,357Updated last year
- SAM: Sharpness-Aware Minimization (PyTorch)β1,950Updated last year
- The official implementation of [CVPR2022] Decoupled Knowledge Distillation https://arxiv.org/abs/2203.08679 and [ICCV2023] DOT: A Distillβ¦β880Updated 2 years ago
- Collection of common code that's shared among different research projects in FAIR computer vision team.β2,203Updated 3 months ago
- OpenMMLab Model Compression Toolbox and Benchmark.β1,651Updated last year
- A curated list of neural network pruning resources.β2,487Updated last year
- [CVPR 2023] DepGraph: Towards Any Structural Pruning; LLMs, Vision Foundation Models, etc.β3,219Updated 3 months ago
- (ICLR 2022 Spotlight) Official PyTorch implementation of "How Do Vision Transformers Work?"β822Updated 3 years ago
- [ICLR 2020] Once for All: Train One Network and Specialize it for Efficient Deploymentβ1,941Updated 2 years ago
- CVNets: A library for training computer vision networksβ1,940Updated 2 years ago
- Escaping the Big Data Paradigm with Compact Transformers, 2021 (Train your Vision Transformers in 30 mins on CIFAR-10 with a single GPU!)β539Updated last year
- Knowledge Distillation: CVPR2020 Oral, Revisiting Knowledge Distillation via Label Smoothing Regularizationβ585Updated 2 years ago
- Implementation of ConvMixer for "Patches Are All You Need? π€·"β1,079Updated 3 years ago
- ICCV2021, Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNetβ1,190Updated 2 years ago
- solo-learn: a library of self-supervised methods for visual representation learning powered by Pytorch Lightningβ1,534Updated last week
- CAIRI Supervised, Semi- and Self-Supervised Visual Representation Learning Toolbox and Benchmarkβ658Updated 2 months ago
- This is a collection of our zero-cost NAS and efficient vision applications.β445Updated 2 years ago
- VISSL is FAIR's library of extensible, modular and scalable components for SOTA Self-Supervised Learning with images.β3,291Updated last year
- Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Modelsβ804Updated 6 months ago
- PyTorch implementation of MoCo v3 https//arxiv.org/abs/2104.02057β1,306Updated 4 years ago
- Codebase for Image Classification Research, written in PyTorch.β2,168Updated last year
- An All-MLP solution for Vision, from Google AIβ1,053Updated 5 months ago
- Official Pytorch Implementation of: "ImageNet-21K Pretraining for the Masses"(NeurIPS, 2021) paperβ777Updated 2 years ago