Alternatives and similar repositories for px-ntk-pruning

Users that are interested in px-ntk-pruning are comparing it to the libraries listed below

• OPTML-Group / Robust-MoE-CNN
  [ICCV23] Robust Mixture-of-Expert Training for Convolutional Neural Networks by Yihua Zhang, Ruisi Cai, Tianlong Chen, Guanhua Zhang, Hua…
  ☆65Updated 2 years ago
• Jin-Ying / Multi-Level-Logit-Distillation
  Code for 'Multi-level Logit Distillation' (CVPR2023)
  ☆70Updated last year
• shaoshitong / plotlydict
  这里陈列了我编写的一些关于深度学习的画图工具，如果觉得有帮助可以给个star.
  ☆42Updated 3 years ago
• zhengli97 / CTKD
  [AAAI 2023] Official PyTorch Code for "Curriculum Temperature for Knowledge Distillation"
  ☆179Updated 10 months ago
• ziplab / SN-Net
  [CVPR 2023 Highlight] This is the official implementation of "Stitchable Neural Networks".
  ☆249Updated 2 years ago
• hunto / DiffKD
  Official implementation for paper "Knowledge Diffusion for Distillation", NeurIPS 2023
  ☆90Updated last year
• Hao840 / OFAKD
  PyTorch code and checkpoints release for OFA-KD: https://arxiv.org/abs/2310.19444
  ☆131Updated last year
• Haochen-Wang409 / DropPos
  [NeurIPS'23] DropPos: Pre-Training Vision Transformers by Reconstructing Dropped Positions
  ☆62Updated last year
• Daner-Wang / VTC-LFC
  ☆27Updated 2 years ago
• OpenGVLab / DiffRate
  [ICCV 23]An approach to enhance the efficiency of Vision Transformer (ViT) by concurrently employing token pruning and token merging tech…
  ☆101Updated 2 years ago
• Jasonlee1995 / ImageNet-1K
  ImageNet-1K data download, processing for using as a dataset
  ☆114Updated 2 years ago
• lliai / Awesome-Low-Rank-Adaptation
  Awesome-Low-Rank-Adaptation
  ☆116Updated last year
• NUS-HPC-AI-Lab / DATM
  ICLR 2024, Towards Lossless Dataset Distillation via Difficulty-Aligned Trajectory Matching
  ☆100Updated last year
• GzyAftermath / CAT-KD
  CVPR 2023, Class Attention Transfer Based Knowledge Distillation
  ☆46Updated 2 years ago
• Hao840 / manifold-distillation
  Learning Efficient Vision Transformers via Fine-Grained Manifold Distillation. NeurIPS 2022.
  ☆32Updated 3 years ago
• Rose-STL-Lab / Teleportation-Optimization
  [ICLR 2024 Oral] Improving Convergence and Generalization Using Parameter Symmetries
  ☆29Updated last year
• xxgege / GAM
  The official repo for CVPR2023 highlight paper "Gradient Norm Aware Minimization Seeks First-Order Flatness and Improves Generalization".
  ☆84Updated 2 years ago
• WangYZ1608 / Knowledge-Distillation-via-ND
  The official implementation for paper: Improving Knowledge Distillation via Regularizing Feature Norm and Direction
  ☆22Updated 2 years ago
• lliai / DisWOT-CVPR2023
  ☆28Updated last year
• hunto / image_classification_sota
  Training ImageNet / CIFAR models with sota strategies and fancy techniques such as ViT, KD, Rep, etc.
  ☆84Updated last year
• hunto / DIST_KD
  Official implementation of paper "Knowledge Distillation from A Stronger Teacher", NeurIPS 2022
  ☆149Updated 2 years ago
• vimar-gu / MinimaxDiffusion
  [CVPR2024] Efficient Dataset Distillation via Minimax Diffusion
  ☆98Updated last year
• zju-SWJ / RLD
  Official implementation for "Knowledge Distillation with Refined Logits".
  ☆16Updated last year
• VILA-Lab / SRe2L
  (NeurIPS 2023 spotlight) Large-scale Dataset Distillation/Condensation, 50 IPC (Images Per Class) achieves the highest 60.8% on original …
  ☆129Updated 11 months ago
• aim-uofa / LoRAPrune
  ☆59Updated 10 months ago
• MingSun-Tse / Awesome-Efficient-ViT
  Recent Advances on Efficient Vision Transformers
  ☆54Updated 2 years ago
• yolky / RCIG
  ☆14Updated 2 years ago
• JiamingLv / WKD
  The offical implementation of [NeurIPS2024] Wasserstein Distance Rivals Kullback-Leibler Divergence for Knowledge Distillation https://ar…
  ☆44Updated 10 months ago
• DefangChen / Knowledge-Distillation-Paper
  This resposity maintains a collection of important papers on knowledge distillation (awesome-knowledge-distillation)).
  ☆80Updated 6 months ago
• ROIM1998 / APT
  [ICML'24 Oral] APT: Adaptive Pruning and Tuning Pretrained Language Models for Efficient Training and Inference
  ☆45Updated last year