vrvlive / knowlege-distillationLinks
PyTorch, PyTorch Lightning framework for trying knowledge distillation in image classification problems
☆32Updated last year
Alternatives and similar repositories for knowlege-distillation
Users that are interested in knowlege-distillation are comparing it to the libraries listed below
Sorting:
- Implementation of Online Label Smoothing in PyTorch☆95Updated 2 years ago
- ☆95Updated 2 years ago
- State-of-the-art data augmentation search algorithms in PyTorch☆47Updated 2 years ago
- ☆17Updated 5 years ago
- [ICCV 2021] MosaicOS: A Simple and Effective Use of Object-Centric Images for Long-Tailed Object Detection☆29Updated 3 years ago
- The official implementation of You Only Compress Once: Towards Effective and Elastic BERT Compression via Exploit-Explore Stochastic Natu…☆48Updated 4 years ago
- TF 2 implementation Learning to Resize Images for Computer Vision Tasks (https://arxiv.org/abs/2103.09950v1).☆53Updated 3 years ago
- Polyloss Pytorch Implementation☆45Updated 3 years ago
- [Preprint] ConvMLP: Hierarchical Convolutional MLPs for Vision, 2021☆167Updated 2 years ago
- PyTorch samplers that output roughly balanced batches with support for multilabel datasets☆57Updated last year
- Implementing PolyLoss in Pytorch☆76Updated 3 years ago
- Implementation of Cross Transformer for spatially-aware few-shot transfer, in Pytorch☆53Updated 4 years ago
- ☆57Updated 4 years ago
- [ICLR 2023] This repository includes the official implementation our paper "Can CNNs Be More Robust Than Transformers?"☆143Updated 2 years ago
- [ICME 2022] code for the paper, SimVit: Exploring a simple vision transformer with sliding windows.☆68Updated 2 years ago
- Official code for Group-Transformer (Scale down Transformer by Grouping Features for a Lightweight Character-level Language Model, COLING…☆25Updated 4 years ago
- custom pytorch implementation of MoCo v3☆46Updated 4 years ago
- Pytorch cyclic cosine decay learning rate scheduler☆49Updated 4 years ago
- Implementing DropPath/StochasticDepth in PyTorch☆16Updated 3 years ago
- 1st Place Solution in Google Universal Image Embedding☆67Updated 2 years ago
- [kaggle] 3rd place solution☆32Updated 4 years ago
- A simple wrapper library for binding timm models as detectron2 backbones☆43Updated 2 years ago
- Official PyTorch implementation of RIO☆19Updated 4 years ago
- ☆53Updated 4 years ago
- [ICLR 2022] "As-ViT: Auto-scaling Vision Transformers without Training" by Wuyang Chen, Wei Huang, Xianzhi Du, Xiaodan Song, Zhangyang Wa…☆76Updated 3 years ago
- Reproducing the Linear Multihead Attention introduced in Linformer paper (Linformer: Self-Attention with Linear Complexity)☆75Updated 5 years ago
- This repo is for our paper: Normalization Techniques in Training DNNs: Methodology, Analysis and Application☆85Updated 4 years ago
- Official PyTorch implementation of the paper: "Solving ImageNet: a Unified Scheme for Training any Backbone to Top Results" (2022)☆193Updated 2 years ago
- TF2 implementation of knowledge distillation using the "function matching" hypothesis from https://arxiv.org/abs/2106.05237.☆87Updated 3 years ago
- PyTorch implementation of "MLP-Mixer: An all-MLP Architecture for Vision" Tolstikhin et al. (2021)☆31Updated 4 years ago