UbiquitousLearning / Backpropagation_Free_Training_Survey

Related projects ⓘ

Alternatives and complementary repositories for Backpropagation_Free_Training_Survey

• UbiquitousLearning / FwdLLM
  ☆22Updated 5 months ago
• falcon-xu / early-exit-papers
  A curated list of early exiting (LLM, CV, NLP, etc)
  ☆29Updated 3 months ago
• ZO-Bench / ZO-LLM
  [ICML 2024] Official code for the paper "Revisiting Zeroth-Order Optimization for Memory-Efficient LLM Fine-Tuning: A Benchmark ".
  ☆75Updated 4 months ago
• UbiquitousLearning / Paper-list-resource-efficient-large-language-model
  ☆95Updated 10 months ago
• OPTML-Group / DeepZero
  [ICLR'24] "DeepZero: Scaling up Zeroth-Order Optimization for Deep Model Training" by Aochuan Chen*, Yimeng Zhang*, Jinghan Jia, James Di…
  ☆43Updated last month
• tiingweii-shii / Awesome-Resource-Efficient-LLM-Papers
  a curated list of high-quality papers on resource-efficient LLMs 🌱
  ☆80Updated last week
• lzhangbv / acpsgd
  [ICDCS 2023] Evaluation and Optimization of Gradient Compression for Distributed Deep Learning
  ☆10Updated last year
• theyoungkwon / TinyTrain
  The official implementation of TinyTrain [ICML '24]
  ☆20Updated 4 months ago
• AIoT-MLSys-Lab / FedAIoT
  [DMLR 2024] FedAIoT: A Federated Learning Benchmark for Artificial Intelligence of Things
  ☆49Updated 2 months ago
• git-disl / Lisa
  This is the official code for the paper "Lazy Safety Alignment for Large Language Models against Harmful Fine-tuning" (NeurIPS2024)
  ☆10Updated 2 months ago
• streethagore / ForwardLocalGradient
  This is the official implementation of the ICML 2023 paper - Can Forward Gradient Match Backpropagation ?
  ☆10Updated last year
• SymbioticLab / ModelKeeper
  A Cluster-Wide Model Manager to Accelerate DNN Training via Automated Training Warmup
  ☆34Updated last year
• nsfzyzz / loss_landscape_taxonomy
  [NeurIPS 2021] code for "Taxonomizing local versus global structure in neural network loss landscapes" https://arxiv.org/abs/2107.11228
  ☆18Updated 2 years ago
• UbiquitousLearning / Efficient_Foundation_Model_Survey
  Survey Paper List - Efficient LLM and Foundation Models
  ☆224Updated 2 months ago
• hrcheng1066 / awesome-pruning
  ☆169Updated 3 months ago
• kimihe / Octo
  Create tiny ML systems for on-device learning.
  ☆20Updated 3 years ago
• devansh20la / LPF-SGD
  ☆14Updated last year
• yxli2123 / LoSparse
  ☆47Updated last year
• luuyin / OWL
  Official Pytorch Implementation of "Outlier Weighed Layerwise Sparsity (OWL): A Missing Secret Sauce for Pruning LLMs to High Sparsity"
  ☆51Updated 4 months ago
• UbiquitousLearning / FedAdapter
  "Efficient Federated Learning for Modern NLP", to appear at MobiCom 2023.
  ☆32Updated last year
• DS3Lab / AC-SGD
  Code associated with the paper **Fine-tuning Language Models over Slow Networks using Activation Compression with Guarantees**.
  ☆26Updated last year
• AmberLJC / FLsystem-paper
  Federated Learning Systems Paper List
  ☆68Updated 9 months ago
• HazyResearch / fly
  ☆194Updated last year
• OPTML-Group / Unlearn-Sparse
  [NeurIPS23 (Spotlight)] "Model Sparsity Can Simplify Machine Unlearning" by Jinghan Jia*, Jiancheng Liu*, Parikshit Ram, Yuguang Yao, Gao…
  ☆64Updated 8 months ago
• git-disl / scale-fl
  Code for ScaleFL
  ☆29Updated last year
• SonyResearch / MocoSFL
  Official Repository for MocoSFL (accepted by ICLR '23, notable 5%)
  ☆52Updated last year
• shizhouxing / Local-Lipschitz-Constants
  [NeurIPS 2022] Code for paper "Efficiently Computing Local Lipschitz Constants of Neural Networks via Bound Propagation"
  ☆22Updated 11 months ago
• LINs-lab / FedTHE
  [ICLR 2023] Test-time Robust Personalization for Federated Learning
  ☆53Updated last year
• Shiweiliuiiiiiii / In-Time-Over-Parameterization
  [ICML 2021] "Do We Actually Need Dense Over-Parameterization? In-Time Over-Parameterization in Sparse Training" by Shiwei Liu, Lu Yin, De…
  ☆46Updated last year
• VITA-Group / GraNet
  [Neurips 2021] Sparse Training via Boosting Pruning Plasticity with Neuroregeneration
  ☆29Updated last year