Alternatives and similar repositories for SubZero

Users that are interested in SubZero are comparing it to the libraries listed below

• Yanjun-Zhao / HiZOO
  Second-Order Fine-Tuning without Pain for LLMs: a Hessian Informed Zeroth-Order Optimizer
  ☆15Updated 3 months ago
• ZO-Bench / ZO-LLM
  [ICML 2024] Official code for the paper "Revisiting Zeroth-Order Optimization for Memory-Efficient LLM Fine-Tuning: A Benchmark ".
  ☆104Updated 11 months ago
• Clin0212 / HydraLoRA
  [NeurIPS'24 Oral] HydraLoRA: An Asymmetric LoRA Architecture for Efficient Fine-Tuning
  ☆203Updated 6 months ago
• Outsider565 / LoRA-GA
  ☆198Updated 7 months ago
• OPTML-Group / DeepZero
  [ICLR'24] "DeepZero: Scaling up Zeroth-Order Optimization for Deep Model Training" by Aochuan Chen*, Yimeng Zhang*, Jinghan Jia, James Di…
  ☆57Updated 7 months ago
• Hsu1023 / DuQuant
  [NeurIPS 2024 Oral🔥] DuQuant: Distributing Outliers via Dual Transformation Makes Stronger Quantized LLMs.
  ☆161Updated 8 months ago
• GraphPKU / PiSSA
  PiSSA: Principal Singular Values and Singular Vectors Adaptation of Large Language Models(NeurIPS 2024 Spotlight)
  ☆356Updated 4 months ago
• Chongjie-Si / Subspace-Tuning
  A generalized framework for subspace tuning methods in parameter efficient fine-tuning.
  ☆142Updated 4 months ago
• QingruZhang / AdaLoRA
  AdaLoRA: Adaptive Budget Allocation for Parameter-Efficient Fine-Tuning (ICLR 2023).
  ☆329Updated 2 years ago
• zyushun / hessian-spectrum
  Code for the paper: Why Transformers Need Adam: A Hessian Perspective
  ☆59Updated 2 months ago
• fqhank / Align-KD
  ☆20Updated 3 months ago
• amazon-science / mezo_svrg
  Code the ICML 2024 paper: "Variance-reduced Zeroth-Order Methods for Fine-Tuning Language Models"
  ☆11Updated 11 months ago
• ThreeSR / Awesome-Inference-Time-Scaling
  Paper List of Inference/Test Time Scaling/Computing
  ☆246Updated this week
• NVlabs / Fast-dLLM
  ☆144Updated this week
• liyunqianggyn / Awesome-LLMs-Pruning
  Awesome LLM pruning papers all-in-one repository with integrating all useful resources and insights.
  ☆88Updated 6 months ago
• wutaiqiang / MoSLoRA
  ☆105Updated 11 months ago
• optsuite / LOZO
  ☆12Updated 6 months ago
• lliai / Awesome-LoRA-Low-Rank-Adaptation
  Awesome-Low-Rank-Adaptation
  ☆102Updated 7 months ago
• biomedical-cybernetics / Relative-importance-and-activation-pruning
  ☆43Updated 11 months ago
• zyxxmu / DSnoT
  Official Pytorch Implementation of Our Paper Accepted at ICLR 2024-- Dynamic Sparse No Training: Training-Free Fine-tuning for Sparse LLM…
  ☆47Updated last year
• wangqinsi1 / Dobi-SVD
  Official code implementation for 2025 ICLR accepted paper "Dobi-SVD : Differentiable SVD for LLM Compression and Some New Perspectives"
  ☆31Updated 2 months ago
• ROIM1998 / APT
  [ICML'24 Oral] APT: Adaptive Pruning and Tuning Pretrained Language Models for Efficient Training and Inference
  ☆39Updated last year
• aim-uofa / LoRAPrune
  ☆54Updated 5 months ago
• daixiangzi / Awesome-Token-Compress
  A paper list of some recent works about Token Compress for Vit and VLM
  ☆496Updated last week
• jianghoucheng / AlphaEdit
  AlphaEdit: Null-Space Constrained Knowledge Editing for Language Models, ICLR 2025 (Outstanding Paper)
  ☆250Updated last month
• ZHITENGLI / ARB-LLM
  PyTorch code for our paper "ARB-LLM: Alternating Refined Binarizations for Large Language Models"
  ☆24Updated 2 months ago
• vectozavr / llm-hessian
  Using PyTorch autograd to compute Hessian of Perplexity for Large Language Models
  ☆22Updated last month
• ThisisBillhe / EfficientDM
  [ICLR 2024 Spotlight] This is the official PyTorch implementation of "EfficientDM: Efficient Quantization-Aware Fine-Tuning of Low-Bit Di…
  ☆60Updated last year
• adreamwu / PTQ4DiT
  PyTorch implementation of PTQ4DiT https://arxiv.org/abs/2405.16005
  ☆30Updated 6 months ago
• haiquanlu / AlphaPruning
  [NeurIPS 2024] AlphaPruning: Using Heavy-Tailed Self Regularization Theory for Improved Layer-wise Pruning of Large Language Models
  ☆23Updated 2 months ago