Alternatives and similar repositories for Backpropagation_Free_Training_Survey

Users that are interested in Backpropagation_Free_Training_Survey are comparing it to the libraries listed below

• ZO-Bench / ZO-LLM
  [ICML 2024] Official code for the paper "Revisiting Zeroth-Order Optimization for Memory-Efficient LLM Fine-Tuning: A Benchmark ".
  ☆109Updated last month
• Yanjun-Zhao / HiZOO
  Second-Order Fine-Tuning without Pain for LLMs: a Hessian Informed Zeroth-Order Optimizer
  ☆16Updated 6 months ago
• OPTML-Group / DeepZero
  [ICLR'24] "DeepZero: Scaling up Zeroth-Order Optimization for Deep Model Training" by Aochuan Chen*, Yimeng Zhang*, Jinghan Jia, James Di…
  ☆66Updated 10 months ago
• falcon-xu / early-exit-papers
  A curated list of early exiting (LLM, CV, NLP, etc)
  ☆58Updated 11 months ago
• UbiquitousLearning / Efficient_Foundation_Model_Survey
  Survey Paper List - Efficient LLM and Foundation Models
  ☆253Updated 10 months ago
• andyjm3 / SLTrain
  SLTrain: a sparse plus low-rank approach for parameter and memory efficient pretraining (NeurIPS 2024)
  ☆32Updated 9 months ago
• UbiquitousLearning / FwdLLM
  ☆35Updated last year
• AIoT-MLSys-Lab / FedAIoT
  [DMLR 2024] FedAIoT: A Federated Learning Benchmark for Artificial Intelligence of Things
  ☆58Updated 11 months ago
• ycjing / Awesome-Model-Merging
  A curated list of Model Merging methods.
  ☆92Updated 10 months ago
• hanruiqian / Awesome-Federated-LLM-Related-Works
  ☆18Updated last year
• Jiacheng-Zhu-AIML / AsymmetryLoRA
  Preprint: Asymmetry in Low-Rank Adapters of Foundation Models
  ☆35Updated last year
• UbiquitousLearning / FedAdapter
  "Efficient Federated Learning for Modern NLP", to appear at MobiCom 2023.
  ☆34Updated last year
• osehmathias / lisa
  LISA: Layerwise Importance Sampling for Memory-Efficient Large Language Model Fine-Tuning
  ☆33Updated last year
• ATP-1010 / FederatedLLM
  ☆87Updated 7 months ago
• EnnengYang / AdaMerging
  AdaMerging: Adaptive Model Merging for Multi-Task Learning. ICLR, 2024.
  ☆88Updated 9 months ago
• zyushun / hessian-spectrum
  Code for the paper: Why Transformers Need Adam: A Hessian Perspective
  ☆61Updated 5 months ago
• guobbin / PFL-MoE
  Federated Learning - PyTorch
  ☆14Updated 4 years ago
• yxli2123 / LoSparse
  ☆59Updated last year
• LiuXiaoxuanPKU / OSD
  ☆55Updated 8 months ago
• FengHZ / BAFFLE
  The official implement of paper "Does Federated Learning Really Need Backpropagation?"
  ☆23Updated 2 years ago
• epfml / ChocoSGD
  Decentralized SGD and Consensus with Communication Compression: https://arxiv.org/abs/1907.09356
  ☆71Updated 4 years ago
• Pengxin-Guo / FedSA-LoRA
  Selective Aggregation for Low-Rank Adaptation in Federated Learning [ICLR 2025]
  ☆40Updated 3 months ago
• NJUDeepEngine / meteora
  This repository contains the implementation of the paper "MeteoRA: Multiple-tasks Embedded LoRA for Large Language Models".
  ☆20Updated 2 months ago
• cjyaras / deep-lora-transformers
  Compressible Dynamics in Deep Overparameterized Low-Rank Learning & Adaptation (ICML'24 Oral)
  ☆13Updated last year
• tanganke / weight-ensembling_MoE
  Code for paper "Merging Multi-Task Models via Weight-Ensembling Mixture of Experts"
  ☆29Updated last year
• ml4ai / fed-recon
  Federated reconnaissance mini-ImageNet benchmark and baseline models
  ☆13Updated 3 years ago
• pan-x-c / EE-LLM
  EE-LLM is a framework for large-scale training and inference of early-exit (EE) large language models (LLMs).
  ☆66Updated last year
• JingXuTHU / Random-Masking-Finds-Winning-Tickets-for-Parameter-Efficient-Fine-tuning
  ☆14Updated last year
• epfml / optML-pku
  summer school materials
  ☆44Updated 2 years ago
• theyoungkwon / TinyTrain
  The official implementation of TinyTrain [ICML '24]
  ☆22Updated last year