Alternatives and similar repositories for knowlege-distillation

Users that are interested in knowlege-distillation are comparing it to the libraries listed below

• ankandrew / online-label-smoothing-pt
  Implementation of Online Label Smoothing in PyTorch
  ☆94Updated 2 years ago
• Alibaba-MIIL / ZS_SDL
  Official Pytorch Implementation of: "Semantic Diversity Learning for Zero-Shot Multi-label Classification"(ICCV, 2021) paper
  ☆30Updated 2 years ago
• lucidrains / cross-transformers-pytorch
  Implementation of Cross Transformer for spatially-aware few-shot transfer, in Pytorch
  ☆53Updated 4 years ago
• bellymonster / Weighted-Soft-Label-Distillation
  ☆57Updated 3 years ago
• littleredxh / HardNegative
  ☆51Updated 4 years ago
• alldbi / SuperMix
  Pytorch implementation of CVPR2021 paper: SuperMix: Supervising the Mixing Data Augmentation
  ☆92Updated 3 years ago
• CupidJay / MoCov3-pytorch
  custom pytorch implementation of MoCo v3
  ☆45Updated 4 years ago
• lucidrains / omninet-pytorch
  Implementation of OmniNet, Omnidirectional Representations from Transformers, in Pytorch
  ☆58Updated 4 years ago
• sayakpaul / Learnable-Image-Resizing
  TF 2 implementation Learning to Resize Images for Computer Vision Tasks (https://arxiv.org/abs/2103.09950v1).
  ☆53Updated 3 years ago
• czhang0528 / MosaicOS
  [ICCV 2021] MosaicOS: A Simple and Effective Use of Object-Centric Images for Long-Tailed Object Detection
  ☆29Updated 3 years ago
• abhuse / polyloss-pytorch
  Polyloss Pytorch Implementation
  ☆44Updated 3 years ago
• wxzs5 / direct-pretraining
  Fast and accurate pipeline for training object detector
  ☆22Updated 4 years ago
• justforforfor / insclr
  ☆28Updated 3 years ago
• VirtuosoResearch / Regularized-Self-Labeling
  A regularized self-labeling approach to improve the generalization and robustness of fine-tuned models
  ☆28Updated 3 years ago
• huangleiBuaa / NormalizationSurvey
  This repo is for our paper: Normalization Techniques in Training DNNs: Methodology, Analysis and Application
  ☆84Updated 3 years ago
• ucasligang / SimViT
  [ICME 2022] code for the paper, SimVit: Exploring a simple vision transformer with sliding windows.
  ☆68Updated 2 years ago
• manoja328 / rodeo
  Official implementation of "RODEO: Replay for Online Object Detection", BMVC 2020
  ☆27Updated 3 years ago
• seominseok0429 / Learning-Loss-for-Active-Learning-Pytorch
  Learning Loss for Active Learning Pytorch Implementation,(reproduction)
  ☆32Updated 5 years ago
• schwartz-lab-NLP / papa
  Code for the PAPA paper
  ☆27Updated 2 years ago
• cheneydon / efficient-bert
  This repository contains the code for the paper in Findings of EMNLP 2021: "EfficientBERT: Progressively Searching Multilayer Perceptron …
  ☆32Updated last year
• sharat29ag / CDAL
  ☆47Updated last year
• jhoon-oh / kd_data
  IJCAI 2021, "Comparing Kullback-Leibler Divergence and Mean Squared Error Loss in Knowledge Distillation"
  ☆41Updated 2 years ago
• Burf / ModelSoups
  ModelSoups for Tensorflow2 and Torch
  ☆48Updated 3 years ago
• 01BB01 / eBayChallenge
  [FGVC9-CVPR 2022] The second place solution for 2nd eBay eProduct Visual Search Challenge.
  ☆26Updated 2 years ago
• VITA-Group / layerGraftedPretraining_ICLR23
  [ICLR 2023] “ Layer Grafted Pre-training: Bridging Contrastive Learning And Masked Image Modeling For Better Representations”, Ziyu Jian…
  ☆24Updated 2 years ago
• clovaai / attention-feature-distillation
  Official implementation for (Show, Attend and Distill: Knowledge Distillation via Attention-based Feature Matching, AAAI-2021)
  ☆117Updated 4 years ago
• VITA-Group / AsViT
  [ICLR 2022] "As-ViT: Auto-scaling Vision Transformers without Training" by Wuyang Chen, Wei Huang, Xianzhi Du, Xiaodan Song, Zhangyang Wa…
  ☆76Updated 3 years ago
• snu-mllab / Co-Mixup
  Official PyTorch implementation of "Co-Mixup: Saliency Guided Joint Mixup with Supermodular Diversity" (ICLR'21 Oral)
  ☆103Updated 3 years ago
• yichen928 / FreeSel
  [NeurIPS 2023] Towards Free Data Selection with General-Purpose Models
  ☆38Updated 2 months ago
• lnsmith54 / CFL
  ☆95Updated 2 years ago