yoshitomo-matsubara / torchdistillLinks
A coding-free framework built on PyTorch for reproducible deep learning studies. PyTorch Ecosystem. π26 knowledge distillation methods presented at CVPR, ICLR, ECCV, NeurIPS, ICCV, etc are implemented so far. π Trained models, training logs and configurations are available for ensuring the reproducibiliy and benchmark.
β1,525Updated this week
Alternatives and similar repositories for torchdistill
Users that are interested in torchdistill are comparing it to the libraries listed below
Sorting:
- Pytorch implementation of various Knowledge Distillation (KD) methods.β1,707Updated 3 years ago
- A Pytorch Knowledge Distillation library for benchmarking and extending works in the domains of Knowledge Distillation, Pruning, and Quanβ¦β634Updated 2 years ago
- Awesome Knowledge-Distillation. εη±»ζ΄ηηη₯θ―θΈι¦paper(2014-2021)γβ2,606Updated 2 years ago
- A PyTorch implementation for exploring deep and shallow knowledge distillation (KD) experiments with flexibilityβ1,951Updated 2 years ago
- [ICLR 2020] Contrastive Representation Distillation (CRD), and benchmark of recent knowledge distillation methodsβ2,345Updated last year
- This is a collection of our NAS and Vision Transformer work.β1,775Updated 11 months ago
- SAM: Sharpness-Aware Minimization (PyTorch)β1,892Updated last year
- The official implementation of [CVPR2022] Decoupled Knowledge Distillation https://arxiv.org/abs/2203.08679 and [ICCV2023] DOT: A Distillβ¦β862Updated last year
- Knowledge Distillation: CVPR2020 Oral, Revisiting Knowledge Distillation via Label Smoothing Regularizationβ584Updated 2 years ago
- Collection of common code that's shared among different research projects in FAIR computer vision team.β2,147Updated this week
- A curated list of neural network pruning resources.β2,458Updated last year
- Flops counter for neural networks in pytorch frameworkβ2,906Updated 5 months ago
- Gradually-Warmup Learning Rate Scheduler for PyTorchβ990Updated 8 months ago
- VISSL is FAIR's library of extensible, modular and scalable components for SOTA Self-Supervised Learning with images.β3,284Updated last year
- EfficientFormerV2 [ICCV 2023] & EfficientFormer [NeurIPs 2022]β1,057Updated last year
- PoolFormer: MetaFormer Is Actually What You Need for Vision (CVPR 2022 Oral)β1,342Updated last year
- PyTorch implementation of MoCo v3 https//arxiv.org/abs/2104.02057β1,274Updated 3 years ago
- Code release for ConvNeXt V2 modelβ1,783Updated 10 months ago
- [CVPR 2023] DepGraph: Towards Any Structural Pruning; LLMs, Vision Foundation Models, etc.β3,055Updated 2 weeks ago
- Official DeiT repositoryβ4,225Updated last year
- ICCV2021, Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNetβ1,186Updated last year
- This is a collection of our zero-cost NAS and efficient vision applications.β423Updated last year
- An All-MLP solution for Vision, from Google AIβ1,028Updated 9 months ago
- Implementation of ConvMixer for "Patches Are All You Need? π€·"β1,074Updated 2 years ago
- Awesome Knowledge Distillationβ3,697Updated 3 weeks ago
- Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Modelsβ792Updated 3 weeks ago
- [ICLR 2020] Once for All: Train One Network and Specialize it for Efficient Deploymentβ1,925Updated last year
- Recent Transformer-based CV and related works.β1,335Updated last year
- Codebase for Image Classification Research, written in PyTorch.β2,155Updated last year
- Class activation maps for your PyTorch models (CAM, Grad-CAM, Grad-CAM++, Smooth Grad-CAM++, Score-CAM, SS-CAM, IS-CAM, XGrad-CAM, Layer-β¦β2,216Updated last week