Alternatives and similar repositories for Backpropagation_Free_Training_Survey

Users that are interested in Backpropagation_Free_Training_Survey are comparing it to the libraries listed below

• ZO-Bench / ZO-LLM
  [ICML‘24] Official code for the paper "Revisiting Zeroth-Order Optimization for Memory-Efficient LLM Fine-Tuning: A Benchmark ".
  ☆122Updated 6 months ago
• Yanjun-Zhao / HiZOO
  Second-Order Fine-Tuning without Pain for LLMs: a Hessian Informed Zeroth-Order Optimizer
  ☆20Updated 11 months ago
• OPTML-Group / DeepZero
  [ICLR'24] "DeepZero: Scaling up Zeroth-Order Optimization for Deep Model Training" by Aochuan Chen*, Yimeng Zhang*, Jinghan Jia, James Di…
  ☆69Updated last year
• falcon-xu / early-exit-papers
  A curated list of early exiting (LLM, CV, NLP, etc)
  ☆69Updated last year
• didizhu-judy / Model-Tailor
  [ICML 2024] Model Tailor: Mitigating Catastrophic Forgetting in Multi-modal Large Language Models
  ☆35Updated last year
• epfml / optML-pku
  summer school materials
  ☆46Updated 2 years ago
• theyoungkwon / TinyTrain
  The official implementation of TinyTrain [ICML '24]
  ☆23Updated last year
• ycjing / Awesome-Model-Merging
  A curated list of Model Merging methods.
  ☆94Updated last month
• JingXuTHU / Random-Masking-Finds-Winning-Tickets-for-Parameter-Efficient-Fine-tuning
  ☆14Updated last year
• UbiquitousLearning / Efficient_Foundation_Model_Survey
  Survey Paper List - Efficient LLM and Foundation Models
  ☆259Updated last year
• andyjm3 / SLTrain
  SLTrain: a sparse plus low-rank approach for parameter and memory efficient pretraining (NeurIPS 2024)
  ☆38Updated last year
• osehmathias / lisa
  LISA: Layerwise Importance Sampling for Memory-Efficient Large Language Model Fine-Tuning
  ☆36Updated last year
• drimpossible / BudgetCL
  Code for CVPR paper: Computationally Budgeted Continual Learning: What Does Matter?
  ☆18Updated last year
• NJUDeepEngine / meteora
  This repository contains the implementation of the paper "MeteoRA: Multiple-tasks Embedded LoRA for Large Language Models".
  ☆24Updated 7 months ago
• ZIYU-DEEP / Awesome-Information-Bottleneck
  This is a curated list for Information Bottleneck Principle, in memory of Professor Naftali Tishby.
  ☆383Updated last year
• EnnengYang / AdaMerging
  AdaMerging: Adaptive Model Merging for Multi-Task Learning. ICLR, 2024.
  ☆98Updated last year
• LGrCo / L-GreCo
  AN EFFICIENT AND GENERAL FRAMEWORK FOR LAYERWISE-ADAPTIVE GRADIENT COMPRESSION
  ☆14Updated 2 years ago
• UbiquitousLearning / FedAdapter
  "Efficient Federated Learning for Modern NLP", to appear at MobiCom 2023.
  ☆34Updated 2 years ago
• EnnengYang / Awesome-Forgetting-in-Deep-Learning
  A Comprehensive Survey of Forgetting in Deep Learning Beyond Continual Learning. TPAMI, 2024.
  ☆345Updated this week
• devansh20la / LPF-SGD
  ☆17Updated 3 years ago
• AngusDujw / SAF
  ☆35Updated 3 years ago
• nblt / DLDR
  [TPAMI 2023] Low Dimensional Landscape Hypothesis is True: DNNs can be Trained in Tiny Subspaces
  ☆43Updated 3 years ago
• sahagobinda / SGP
  Official [AAAI] Code Repository for "Continual Learning with Scaled Gradient Projection".
  ☆15Updated 2 years ago
• UbiquitousLearning / FwdLLM
  ☆35Updated last year
• jayroxis / CKA-similarity
  An Numpy and PyTorch Implementation of CKA-similarity with CUDA support
  ☆94Updated 4 years ago
• pan-x-c / EE-LLM
  EE-LLM is a framework for large-scale training and inference of early-exit (EE) large language models (LLMs).
  ☆73Updated last year
• lliai / Awesome-Low-Rank-Adaptation
  Awesome-Low-Rank-Adaptation
  ☆126Updated last year
• Hao840 / Awesome-Low-Precision-Training
  A collection of research papers on low-precision training methods
  ☆57Updated 8 months ago
• Jiacheng-Zhu-AIML / AsymmetryLoRA
  Preprint: Asymmetry in Low-Rank Adapters of Foundation Models
  ☆37Updated last year
• epfml / ChocoSGD
  Decentralized SGD and Consensus with Communication Compression: https://arxiv.org/abs/1907.09356
  ☆74Updated 5 years ago