Alternatives and similar repositories for Backpropagation_Free_Training_Survey

Users that are interested in Backpropagation_Free_Training_Survey are comparing it to the libraries listed below

• ZO-Bench / ZO-LLM
  [ICML‘24] Official code for the paper "Revisiting Zeroth-Order Optimization for Memory-Efficient LLM Fine-Tuning: A Benchmark ".
  ☆123Updated 7 months ago
• Yanjun-Zhao / HiZOO
  Second-Order Fine-Tuning without Pain for LLMs: a Hessian Informed Zeroth-Order Optimizer
  ☆23Updated last year
• OPTML-Group / DeepZero
  [ICLR'24] "DeepZero: Scaling up Zeroth-Order Optimization for Deep Model Training" by Aochuan Chen*, Yimeng Zhang*, Jinghan Jia, James Di…
  ☆70Updated last year
• UbiquitousLearning / FwdLLM
  ☆35Updated last year
• falcon-xu / early-exit-papers
  A curated list of early exiting (LLM, CV, NLP, etc)
  ☆70Updated last year
• theyoungkwon / TinyTrain
  The official implementation of TinyTrain [ICML '24]
  ☆24Updated last year
• FengHZ / BAFFLE
  The official implement of paper "Does Federated Learning Really Need Backpropagation?"
  ☆23Updated 3 years ago
• UbiquitousLearning / Efficient_Foundation_Model_Survey
  Survey Paper List - Efficient LLM and Foundation Models
  ☆260Updated last year
• LGrCo / L-GreCo
  AN EFFICIENT AND GENERAL FRAMEWORK FOR LAYERWISE-ADAPTIVE GRADIENT COMPRESSION
  ☆14Updated 2 years ago
• ziyaow1010 / FederatedLLM
  ☆110Updated last year
• guobbin / PFL-MoE
  Federated Learning - PyTorch
  ☆15Updated 4 years ago
• UbiquitousLearning / FedAdapter
  "Efficient Federated Learning for Modern NLP", to appear at MobiCom 2023.
  ☆34Updated 2 years ago
• epfml / optML-pku
  summer school materials
  ☆46Updated 2 years ago
• Pengxin-Guo / FedSA-LoRA
  Selective Aggregation for Low-Rank Adaptation in Federated Learning [ICLR 2025]
  ☆58Updated 9 months ago
• LINs-lab / FedTHE
  [ICLR 2023] Test-time Robust Personalization for Federated Learning
  ☆55Updated 2 years ago
• AIoT-MLSys-Lab / FedAIoT
  [DMLR 2024] FedAIoT: A Federated Learning Benchmark for Artificial Intelligence of Things
  ☆59Updated last year
• facebookresearch / FL_partial_personalization
  Federated Learning with Partial Model Personalization
  ☆42Updated 3 years ago
• andyjm3 / SLTrain
  SLTrain: a sparse plus low-rank approach for parameter and memory efficient pretraining (NeurIPS 2024)
  ☆39Updated last year
• hmarkc / parallel-prompt-decoding
  Efficient LLM Inference Acceleration using Prompting
  ☆51Updated last year
• ycjing / Awesome-Model-Merging
  A curated list of Model Merging methods.
  ☆96Updated 2 months ago
• osehmathias / lisa
  LISA: Layerwise Importance Sampling for Memory-Efficient Large Language Model Fine-Tuning
  ☆36Updated last year
• allen4747 / Ferret
  This is the official implementation for the paper: Ferret: Federated Full-Parameter Tuning at Scale for Large Language Models
  ☆19Updated last year
• illidanlab / SplitMix
  [ICLR2022] Efficient Split-Mix federated learning for in-situ model customization during both training and testing time
  ☆47Updated 2 years ago
• Jiacheng-Zhu-AIML / AsymmetryLoRA
  Preprint: Asymmetry in Low-Rank Adapters of Foundation Models
  ☆38Updated last year
• edvinli / federated-learning-mixture
  Federated learning using a mixture of experts
  ☆17Updated 4 years ago
• zyushun / hessian-spectrum
  Code for the paper: Why Transformers Need Adam: A Hessian Perspective
  ☆63Updated 11 months ago
• didizhu-judy / Model-Tailor
  [ICML 2024] Model Tailor: Mitigating Catastrophic Forgetting in Multi-modal Large Language Models
  ☆35Updated last year
• pan-x-c / EE-LLM
  EE-LLM is a framework for large-scale training and inference of early-exit (EE) large language models (LLMs).
  ☆74Updated last year
• Mercidaiha / IRT-Router
  [ACL'25] Code for ACL'25 paper "IRT-Router: Effective and Interpretable Multi-LLM Routing via Item Response Theory"
  ☆26Updated 11 months ago
• sahagobinda / SGP
  Official [AAAI] Code Repository for "Continual Learning with Scaled Gradient Projection".
  ☆16Updated 2 years ago