Alternatives and similar repositories for knowlege-distillation:

Users that are interested in knowlege-distillation are comparing it to the libraries listed below

• ankandrew / online-label-smoothing-pt
  Implementation of Online Label Smoothing in PyTorch
  ☆94Updated 2 years ago
• czhang0528 / MosaicOS
  [ICCV 2021] MosaicOS: A Simple and Effective Use of Object-Centric Images for Long-Tailed Object Detection
  ☆29Updated 3 years ago
• jhoon-oh / kd_data
  IJCAI 2021, "Comparing Kullback-Leibler Divergence and Mean Squared Error Loss in Knowledge Distillation"
  ☆40Updated 2 years ago
• dwang181 / active-mixup
  Code for Active Mixup in 2020 CVPR
  ☆22Updated 3 years ago
• yichen928 / FreeSel
  [NeurIPS 2023] Towards Free Data Selection with General-Purpose Models
  ☆34Updated 10 months ago
• bellymonster / Weighted-Soft-Label-Distillation
  ☆57Updated 3 years ago
• abhuse / polyloss-pytorch
  Polyloss Pytorch Implementation
  ☆43Updated 2 years ago
• FrancescoSaverioZuppichini / DropPath
  Implementing DropPath/StochasticDepth in PyTorch
  ☆16Updated 3 years ago
• seominseok0429 / Learning-Loss-for-Active-Learning-Pytorch
  Learning Loss for Active Learning Pytorch Implementation,(reproduction)
  ☆32Updated 5 years ago
• VITA-Group / layerGraftedPretraining_ICLR23
  [ICLR 2023] “ Layer Grafted Pre-training: Bridging Contrastive Learning And Masked Image Modeling For Better Representations”, Ziyu Jian…
  ☆23Updated 2 years ago
• yiyixuxu / polyloss-pytorch
  Implementing PolyLoss in Pytorch
  ☆73Updated 2 years ago
• adam-mehdi / MuarAugment
  State-of-the-art data augmentation search algorithms in PyTorch
  ☆47Updated last year
• alldbi / SuperMix
  Pytorch implementation of CVPR2021 paper: SuperMix: Supervising the Mixing Data Augmentation
  ☆92Updated 3 years ago
• tgilewicz / uniformaugment
  Unofficial PyTorch Reimplementation of UniformAugment.
  ☆15Updated 4 years ago
• lucidrains / cross-transformers-pytorch
  Implementation of Cross Transformer for spatially-aware few-shot transfer, in Pytorch
  ☆51Updated 3 years ago
• kakaobrain / coyo-vit
  ViT trained on COYO-Labeled-300M dataset
  ☆31Updated 2 years ago
• Confusezius / Characterizing_Generalization_in_DeepMetricLearning
  Implementation and Benchmark Splits to study Out-of-Distribution Generalization in Deep Metric Learning.
  ☆23Updated 3 years ago
• 01BB01 / eBayChallenge
  [FGVC9-CVPR 2022] The second place solution for 2nd eBay eProduct Visual Search Challenge.
  ☆26Updated 2 years ago
• arghosh / noisy_label_pretrain
  ☆32Updated 3 years ago
• snu-mllab / Co-Mixup
  Official PyTorch implementation of "Co-Mixup: Saliency Guided Joint Mixup with Supermodular Diversity" (ICLR'21 Oral)
  ☆103Updated 3 years ago
• huangleiBuaa / NormalizationSurvey
  This repo is for our paper: Normalization Techniques in Training DNNs: Methodology, Analysis and Application
  ☆84Updated 3 years ago
• lucidrains / omninet-pytorch
  Implementation of OmniNet, Omnidirectional Representations from Transformers, in Pytorch
  ☆57Updated 3 years ago
• cheneydon / efficient-bert
  This repository contains the code for the paper in Findings of EMNLP 2021: "EfficientBERT: Progressively Searching Multilayer Perceptron …
  ☆32Updated last year
• d-li14 / mlp-mixer.pytorch
  PyTorch implementation of MLP-Mixer
  ☆36Updated 3 years ago
• wxzs5 / direct-pretraining
  Fast and accurate pipeline for training object detector
  ☆22Updated 3 years ago
• dddzg / unimoco
  UniMoCo: Unsupervised, Semi-Supervised and Full-Supervised Visual Representation Learning
  ☆54Updated 3 years ago
• sharat29ag / CDAL
  ☆47Updated last year
• lnsmith54 / CFL
  ☆95Updated 2 years ago
• MAC-AutoML / YOCO-BERT
  The official implementation of You Only Compress Once: Towards Effective and Elastic BERT Compression via Exploit-Explore Stochastic Natu…
  ☆48Updated 3 years ago
• da2so / GradCAM_PyTorch
  GradCAM Pytorch
  ☆27Updated 5 months ago