Alternatives and similar repositories for HiZOO:

Users that are interested in HiZOO are comparing it to the libraries listed below

• OPTML-Group / DeepZero
  [ICLR'24] "DeepZero: Scaling up Zeroth-Order Optimization for Deep Model Training" by Aochuan Chen*, Yimeng Zhang*, Jinghan Jia, James Di…
  ☆52Updated 5 months ago
• Shiweiliuiiiiiii / In-Time-Over-Parameterization
  [ICML 2021] "Do We Actually Need Dense Over-Parameterization? In-Time Over-Parameterization in Sparse Training" by Shiwei Liu, Lu Yin, De…
  ☆45Updated last year
• andyjm3 / SLTrain
  SLTrain: a sparse plus low-rank approach for parameter and memory efficient pretraining (NeurIPS 2024)
  ☆30Updated 5 months ago
• boone891214 / MEST
  [NeurIPS‘2021] "MEST: Accurate and Fast Memory-Economic Sparse Training Framework on the Edge", Geng Yuan, Xiaolong Ma, Yanzhi Wang et al…
  ☆18Updated 3 years ago
• ZO-Bench / ZO-LLM
  [ICML 2024] Official code for the paper "Revisiting Zeroth-Order Optimization for Memory-Efficient LLM Fine-Tuning: A Benchmark ".
  ☆95Updated 9 months ago
• zyxxmu / DSnoT
  Official Pytorch Implementation of Our Paper Accepted at ICLR 2024-- Dynamic Sparse No Training: Training-Free Fine-tuning for Sparse LLM…
  ☆45Updated 11 months ago
• lolemacs / continuous-sparsification
  Implementation of Continuous Sparsification, a method for pruning and ticket search in deep networks
  ☆33Updated 2 years ago
• JingXuTHU / Random-Masking-Finds-Winning-Tickets-for-Parameter-Efficient-Fine-tuning
  ☆13Updated 10 months ago
• imagination-research / EEP
  Efficient Expert Pruning for Sparse Mixture-of-Experts Language Models: Enhancing Performance and Reducing Inference Costs
  ☆16Updated 3 months ago
• sahagobinda / SGP
  Official [AAAI] Code Repository for "Continual Learning with Scaled Gradient Projection".
  ☆12Updated last year
• yxli2123 / LoSparse
  ☆50Updated last year
• pvti / Awesome-Tensor-Decomposition
  😎 A curated list of tensor decomposition resources for model compression.
  ☆56Updated this week
• UNITES-Lab / moe-quantization
  Official code for the paper "Examining Post-Training Quantization for Mixture-of-Experts: A Benchmark"
  ☆13Updated 9 months ago
• papers-submission / structured_transposable_masks
  Code for ICML 2021 submission
  ☆34Updated 4 years ago
• lzhangbv / acpsgd
  [ICDCS 2023] Evaluation and Optimization of Gradient Compression for Distributed Deep Learning
  ☆10Updated last year
• VITA-Group / GraNet
  [Neurips 2021] Sparse Training via Boosting Pruning Plasticity with Neuroregeneration
  ☆31Updated 2 years ago
• VITA-Group / ToST
  [ICML2022] Training Your Sparse Neural Network Better with Any Mask. Ajay Jaiswal, Haoyu Ma, Tianlong Chen, ying Ding, and Zhangyang Wang
  ☆27Updated 2 years ago
• MingSun-Tse / Why-the-State-of-Pruning-so-Confusing
  [Preprint] Why is the State of Neural Network Pruning so Confusing? On the Fairness, Comparison Setup, and Trainability in Network Prunin…
  ☆40Updated 2 years ago
• junjieliu2910 / DynamicSparseTraining
  [ICLR-2020] Dynamic Sparse Training: Find Efficient Sparse Network From Scratch With Trainable Masked Layers.
  ☆31Updated 5 years ago
• lzhangbv / eva
  [ICLR 2023] Eva: Practical Second-order Optimization with Kronecker-vectorized Approximation
  ☆12Updated last year
• VITA-Group / ramanujan-on-pai
  [ICLR 2023] 'Revisiting Pruning At Initialization Through The Lens of Ramanujan Graph" by Duc Hoang, Shiwei Liu, Radu Marculescu, Atlas W…
  ☆12Updated last year
• stephane-rivaud / ForwardLocalGradient
  This is the official implementation of the ICML 2023 paper - Can Forward Gradient Match Backpropagation ?
  ☆12Updated last year
• MAC-AutoML / ITPruner
  ☆24Updated 3 years ago
• GATECH-EIC / ShiftAddViT
  [NeurIPS 2023] ShiftAddViT: Mixture of Multiplication Primitives Towards Efficient Vision Transformer
  ☆32Updated last year
• sunggo / APIB
  Code for ICCV23 paper "Automatic network pruning via Hilbert Schmidt independence criterion lasso under information bottleneck principle"
  ☆18Updated last year
• lliai / EMQ-series
  [ICCV-2023] EMQ: Evolving Training-free Proxies for Automated Mixed Precision Quantization
  ☆25Updated last year
• LGrCo / L-GreCo
  AN EFFICIENT AND GENERAL FRAMEWORK FOR LAYERWISE-ADAPTIVE GRADIENT COMPRESSION
  ☆13Updated last year
• MAC-AutoML / OMPQ
  ☆25Updated 3 years ago
• BerivanIsik / sparse-random-networks
  Implementation of the FedPM framework by the authors of the ICLR 2023 paper "Sparse Random Networks for Communication-Efficient Federated…
  ☆28Updated 2 years ago
• MingSun-Tse / Awesome-Pruning-at-Initialization
  [IJCAI'22 Survey] Recent Advances on Neural Network Pruning at Initialization.
  ☆59Updated last year