Alternatives and similar repositories for Backpropagation_Free_Training_Survey

Users that are interested in Backpropagation_Free_Training_Survey are comparing it to the libraries listed below

• ZO-Bench / ZO-LLM
  [ICML‘24] Official code for the paper "Revisiting Zeroth-Order Optimization for Memory-Efficient LLM Fine-Tuning: A Benchmark ".
  ☆120Updated 5 months ago
• OPTML-Group / DeepZero
  [ICLR'24] "DeepZero: Scaling up Zeroth-Order Optimization for Deep Model Training" by Aochuan Chen*, Yimeng Zhang*, Jinghan Jia, James Di…
  ☆67Updated last year
• Yanjun-Zhao / HiZOO
  Second-Order Fine-Tuning without Pain for LLMs: a Hessian Informed Zeroth-Order Optimizer
  ☆20Updated 10 months ago
• andyjm3 / SLTrain
  SLTrain: a sparse plus low-rank approach for parameter and memory efficient pretraining (NeurIPS 2024)
  ☆38Updated last year
• falcon-xu / early-exit-papers
  A curated list of early exiting (LLM, CV, NLP, etc)
  ☆69Updated last year
• ycjing / Awesome-Model-Merging
  A curated list of Model Merging methods.
  ☆94Updated 2 weeks ago
• UbiquitousLearning / FwdLLM
  ☆35Updated last year
• kwignb / NeuralTangentKernel-Papers
  Neural Tangent Kernel Papers
  ☆120Updated 11 months ago
• reds-lab / LAVA
  This is an official repository for "LAVA: Data Valuation without Pre-Specified Learning Algorithms" (ICLR2023).
  ☆52Updated last year
• zyushun / hessian-spectrum
  Code for the paper: Why Transformers Need Adam: A Hessian Perspective
  ☆63Updated 9 months ago
• UbiquitousLearning / Efficient_Foundation_Model_Survey
  Survey Paper List - Efficient LLM and Foundation Models
  ☆258Updated last year
• nblt / DLDR
  [TPAMI 2023] Low Dimensional Landscape Hypothesis is True: DNNs can be Trained in Tiny Subspaces
  ☆42Updated 3 years ago
• cjyaras / deep-lora-transformers
  Compressible Dynamics in Deep Overparameterized Low-Rank Learning & Adaptation (ICML'24 Oral)
  ☆13Updated last year
• Jiacheng-Zhu-AIML / AsymmetryLoRA
  Preprint: Asymmetry in Low-Rank Adapters of Foundation Models
  ☆37Updated last year
• theyoungkwon / TinyTrain
  The official implementation of TinyTrain [ICML '24]
  ☆23Updated last year
• nsfzyzz / loss_landscape_taxonomy
  [NeurIPS 2021] code for "Taxonomizing local versus global structure in neural network loss landscapes" https://arxiv.org/abs/2107.11228
  ☆19Updated 3 years ago
• MinghuiChen43 / awesome-deep-phenomena
  A curated list of papers of interesting empirical study and insight on deep learning. Continually updating...
  ☆382Updated last week
• drimpossible / BudgetCL
  Code for CVPR paper: Computationally Budgeted Continual Learning: What Does Matter?
  ☆18Updated last year
• LGrCo / L-GreCo
  AN EFFICIENT AND GENERAL FRAMEWORK FOR LAYERWISE-ADAPTIVE GRADIENT COMPRESSION
  ☆14Updated 2 years ago
• JingXuTHU / Random-Masking-Finds-Winning-Tickets-for-Parameter-Efficient-Fine-tuning
  ☆14Updated last year
• FengHZ / BAFFLE
  The official implement of paper "Does Federated Learning Really Need Backpropagation?"
  ☆23Updated 2 years ago
• NJUDeepEngine / meteora
  This repository contains the implementation of the paper "MeteoRA: Multiple-tasks Embedded LoRA for Large Language Models".
  ☆24Updated 6 months ago
• locuslab / edge-of-stability
  ☆73Updated last year
• EnnengYang / AdaMerging
  AdaMerging: Adaptive Model Merging for Multi-Task Learning. ICLR, 2024.
  ☆97Updated last year
• WeiHuang05 / Awesome_Large_Foundation_Model_Theory
  Welcome to the 'In Context Learning Theory' Reading Group
  ☆30Updated last year
• AngusDujw / SAF
  ☆35Updated 3 years ago
• osehmathias / lisa
  LISA: Layerwise Importance Sampling for Memory-Efficient Large Language Model Fine-Tuning
  ☆36Updated last year
• jadohu / LANTERN
  Official Implementation of LANTERN (ICLR'25) and LANTERN++(ICLRW-SCOPE'25)
  ☆18Updated 9 months ago
• chengxiang / LinearTransformer
  Pytorch code for experiments on Linear Transformers
  ☆24Updated last year
• Pengxin-Guo / FedSA-LoRA
  Selective Aggregation for Low-Rank Adaptation in Federated Learning [ICLR 2025]
  ☆52Updated 8 months ago