Alternatives and similar repositories for WideNet_Code

Users that are interested in WideNet_Code are comparing it to the libraries listed below

• Hao840 / manifold-distillation
  Learning Efficient Vision Transformers via Fine-Grained Manifold Distillation. NeurIPS 2022.
  ☆32Updated 2 years ago
• lliai / DisWOT-CVPR2023
  ☆26Updated last year
• haohang96 / MRA
  ☆57Updated 2 years ago
• OPTML-Group / Robust-MoE-CNN
  [ICCV23] Robust Mixture-of-Expert Training for Convolutional Neural Networks by Yihua Zhang, Ruisi Cai, Tianlong Chen, Guanhua Zhang, Hua…
  ☆56Updated last year
• Jin-Ying / Multi-Level-Logit-Distillation
  Code for 'Multi-level Logit Distillation' (CVPR2023)
  ☆64Updated 8 months ago
• DefangChen / SimKD
  [CVPR-2022] Official implementation for "Knowledge Distillation with the Reused Teacher Classifier".
  ☆94Updated 2 years ago
• VICO-UoE / IT-GAN
  ☆23Updated last year
• UCSC-VLAA / DMAE
  [CVPR 2023] This repository includes the official implementation our paper "Masked Autoencoders Enable Efficient Knowledge Distillers"
  ☆106Updated last year
• bwconrad / soft-moe
  PyTorch implementation of "From Sparse to Soft Mixtures of Experts"
  ☆57Updated last year
• Daner-Wang / VTC-LFC
  ☆27Updated 2 years ago
• VITA-Group / ViT-Anti-Oversmoothing
  [ICLR 2022] "Anti-Oversmoothing in Deep Vision Transformers via the Fourier Domain Analysis: From Theory to Practice" by Peihao Wang, Wen…
  ☆79Updated last year
• MengLcool / AdaViT
  [CVPR-22] This is the official implementation of the paper "Adavit: Adaptive vision transformers for efficient image recognition".
  ☆54Updated 2 years ago
• zhfeing / Bootstrapping-ViTs-pytorch
  Official pytorch implementation for CVPR2022 paper "Bootstrapping ViTs: Towards Liberating Vision Transformers from Pre-training"
  ☆17Updated 3 years ago
• hunto / DIST_KD
  Official implementation of paper "Knowledge Distillation from A Stronger Teacher", NeurIPS 2022
  ☆146Updated 2 years ago
• winycg / L-MCL
  [TPAMI-2023] Official implementations of L-MCL: Online Knowledge Distillation via Mutual Contrastive Learning for Visual Recognition
  ☆23Updated last year
• Mi-Peng / Sparse-Sharpness-Aware-Minimization
  [NeurIPS 2022] Make Sharpness-Aware Minimization Stronger: A Sparsified Perturbation Approach -- Official Implementation
  ☆44Updated last year
• UMass-Embodied-AGI / Mod-Squad
  ☆87Updated 2 years ago
• jiawangbai / HAT
  Implementation of HAT https://arxiv.org/pdf/2204.00993
  ☆50Updated last year
• hunto / image_classification_sota
  Training ImageNet / CIFAR models with sota strategies and fancy techniques such as ViT, KD, Rep, etc.
  ☆82Updated last year
• OpenGVLab / DiffRate
  [ICCV 23]An approach to enhance the efficiency of Vision Transformer (ViT) by concurrently employing token pruning and token merging tech…
  ☆96Updated last year
• Hao840 / vanillaKD
  PyTorch code and checkpoints release for VanillaKD: https://arxiv.org/abs/2305.15781
  ☆75Updated last year
• AngusDujw / FTD-distillation
  The code of the paper "Minimizing the Accumulated Trajectory Error to Improve Dataset Distillation" (CVPR2023)
  ☆40Updated 2 years ago
• Meta-knowledge-Lab / DLB
  Code for Paper "Self-Distillation from the Last Mini-Batch for Consistency Regularization"
  ☆40Updated 2 years ago
• MingSun-Tse / Good-DA-in-KD
  [NeurIPS'22] What Makes a "Good" Data Augmentation in Knowledge Distillation -- A Statistical Perspective
  ☆37Updated 2 years ago
• VITA-Group / BackRazor_Neurips22
  [Neurips 2022] “ Back Razor: Memory-Efficient Transfer Learning by Self-Sparsified Backpropogation”, Ziyu Jiang*, Xuxi Chen*, Xueqin Huan…
  ☆19Updated 2 years ago
• shawnricecake / search-llm
  [NeurIPS 2024] Search for Efficient LLMs
  ☆14Updated 4 months ago
• YifanXu74 / Evo-ViT
  Official implement of Evo-ViT: Slow-Fast Token Evolution for Dynamic Vision Transformer
  ☆72Updated 2 years ago
• MingSun-Tse / TPP
  [ICLR'23] Trainability Preserving Neural Pruning (PyTorch)
  ☆32Updated 2 years ago
• hunto / DiffKD
  Official implementation for paper "Knowledge Diffusion for Distillation", NeurIPS 2023
  ☆86Updated last year
• xiusu / ViTAS
  Code for ViTAS_Vision Transformer Architecture Search
  ☆50Updated 3 years ago