Alternatives and similar repositories for Backpropagation_Free_Training_Survey

Users that are interested in Backpropagation_Free_Training_Survey are comparing it to the libraries listed below

• ZO-Bench / ZO-LLM
  [ICML‘24] Official code for the paper "Revisiting Zeroth-Order Optimization for Memory-Efficient LLM Fine-Tuning: A Benchmark ".
  ☆111Updated 3 months ago
• falcon-xu / early-exit-papers
  A curated list of early exiting (LLM, CV, NLP, etc)
  ☆65Updated last year
• Yanjun-Zhao / HiZOO
  Second-Order Fine-Tuning without Pain for LLMs: a Hessian Informed Zeroth-Order Optimizer
  ☆20Updated 8 months ago
• OPTML-Group / DeepZero
  [ICLR'24] "DeepZero: Scaling up Zeroth-Order Optimization for Deep Model Training" by Aochuan Chen*, Yimeng Zhang*, Jinghan Jia, James Di…
  ☆66Updated last year
• UbiquitousLearning / Efficient_Foundation_Model_Survey
  Survey Paper List - Efficient LLM and Foundation Models
  ☆258Updated last year
• LGrCo / L-GreCo
  AN EFFICIENT AND GENERAL FRAMEWORK FOR LAYERWISE-ADAPTIVE GRADIENT COMPRESSION
  ☆14Updated last year
• theyoungkwon / TinyTrain
  The official implementation of TinyTrain [ICML '24]
  ☆22Updated last year
• ycjing / Awesome-Model-Merging
  A curated list of Model Merging methods.
  ☆91Updated last year
• ml4ai / fed-recon
  Federated reconnaissance mini-ImageNet benchmark and baseline models
  ☆13Updated 4 years ago
• UbiquitousLearning / FwdLLM
  ☆35Updated last year
• osehmathias / lisa
  LISA: Layerwise Importance Sampling for Memory-Efficient Large Language Model Fine-Tuning
  ☆35Updated last year
• Shiweiliuiiiiiii / In-Time-Over-Parameterization
  [ICML 2021] "Do We Actually Need Dense Over-Parameterization? In-Time Over-Parameterization in Sparse Training" by Shiwei Liu, Lu Yin, De…
  ☆45Updated last year
• UbiquitousLearning / FedAdapter
  "Efficient Federated Learning for Modern NLP", to appear at MobiCom 2023.
  ☆34Updated 2 years ago
• UbiquitousLearning / Paper-list-resource-efficient-large-language-model
  ☆100Updated last year
• didizhu-judy / Model-Tailor
  ☆29Updated last year
• lliai / Awesome-Low-Rank-Adaptation
  Awesome-Low-Rank-Adaptation
  ☆116Updated last year
• LINs-lab / FedTHE
  [ICLR 2023] Test-time Robust Personalization for Federated Learning
  ☆53Updated 2 years ago
• withinmiaov / A-Survey-on-Mixture-of-Experts-in-LLMs
  [TKDE'25] The official GitHub page for the survey paper "A Survey on Mixture of Experts in Large Language Models".
  ☆435Updated 2 months ago
• txsun1997 / awesome-early-exiting
  A curated list of Early Exiting papers, benchmarks, and misc.
  ☆117Updated last year
• boone891214 / MEST
  [NeurIPS‘2021] "MEST: Accurate and Fast Memory-Economic Sparse Training Framework on the Edge", Geng Yuan, Xiaolong Ma, Yanzhi Wang et al…
  ☆18Updated 3 years ago
• jayroxis / CKA-similarity
  An Numpy and PyTorch Implementation of CKA-similarity with CUDA support
  ☆94Updated 4 years ago
• tiingweii-shii / Awesome-Resource-Efficient-LLM-Papers
  a curated list of high-quality papers on resource-efficient LLMs 🌱
  ☆140Updated 7 months ago
• hmarkc / parallel-prompt-decoding
  Efficient LLM Inference Acceleration using Prompting
  ☆50Updated 11 months ago
• yxli2123 / LoSparse
  ☆61Updated 2 years ago
• EnnengYang / AdaMerging
  AdaMerging: Adaptive Model Merging for Multi-Task Learning. ICLR, 2024.
  ☆92Updated 11 months ago
• hdong920 / GRIFFIN
  ☆38Updated last year
• ziyaow1010 / FederatedLLM
  ☆92Updated 9 months ago
• AIoT-MLSys-Lab / FedAIoT
  [DMLR 2024] FedAIoT: A Federated Learning Benchmark for Artificial Intelligence of Things
  ☆58Updated last year
• UCSD-SEELab / iot-hd-reading-group
  Collections of paper reviews in SEELab, related to IoT/HD/ML etc.
  ☆32Updated 5 months ago
• zyxxmu / cam
  Pytorch implementation of our paper accepted by ICML 2024 -- CaM: Cache Merging for Memory-efficient LLMs Inference
  ☆47Updated last year