UbiquitousLearning / Backpropagation_Free_Training_Survey

Related projects ⓘ

Alternatives and complementary repositories for Backpropagation_Free_Training_Survey

• UbiquitousLearning / FwdLLM
  ☆21Updated 5 months ago
• falcon-xu / early-exit-papers
  A curated list of early exiting (LLM, CV, NLP, etc)
  ☆29Updated 2 months ago
• UbiquitousLearning / Paper-list-resource-efficient-large-language-model
  ☆94Updated 9 months ago
• ZO-Bench / ZO-LLM
  [ICML 2024] Official code for the paper "Revisiting Zeroth-Order Optimization for Memory-Efficient LLM Fine-Tuning: A Benchmark ".
  ☆73Updated 4 months ago
• theyoungkwon / TinyTrain
  The official implementation of TinyTrain [ICML '24]
  ☆20Updated 3 months ago
• lzhangbv / acpsgd
  [ICDCS 2023] Evaluation and Optimization of Gradient Compression for Distributed Deep Learning
  ☆10Updated last year
• YouAreSpecialToMe / QST
  Quantized Side Tuning: Fast and Memory-Efficient Tuning of Quantized Large Language Models
  ☆35Updated last week
• yxli2123 / LoSparse
  ☆46Updated last year
• UbiquitousLearning / FedAdapter
  "Efficient Federated Learning for Modern NLP", to appear at MobiCom 2023.
  ☆31Updated last year
• bibikar / feddst
  Federated Dynamic Sparse Training
  ☆29Updated 2 years ago
• zyxxmu / DSnoT
  Official Pytorch Implementation of Our Paper Accepted at ICLR 2024-- Dynamic Sparse No Training: Training-Free Fine-tuning for Sparse LLM…
  ☆36Updated 7 months ago
• Hsu1023 / DuQuant
  [NeurIPS 2024 Oral🔥] DuQuant: Distributing Outliers via Dual Transformation Makes Stronger Quantized LLMs.
  ☆101Updated last month
• SymbioticLab / ModelKeeper
  A Cluster-Wide Model Manager to Accelerate DNN Training via Automated Training Warmup
  ☆33Updated last year
• xvyaward / owq
  Code for the AAAI 2024 Oral paper "OWQ: Outlier-Aware Weight Quantization for Efficient Fine-Tuning and Inference of Large Language Model…
  ☆53Updated 8 months ago
• IST-DASLab / OBC
  Code for the NeurIPS 2022 paper "Optimal Brain Compression: A Framework for Accurate Post-Training Quantization and Pruning".
  ☆102Updated last year
• guobbin / PFL-MoE
  Federated Learning - PyTorch
  ☆15Updated 3 years ago
• UbiquitousLearning / Efficient_Foundation_Model_Survey
  Survey Paper List - Efficient LLM and Foundation Models
  ☆217Updated last month
• tiingweii-shii / Awesome-Resource-Efficient-LLM-Papers
  a curated list of high-quality papers on resource-efficient LLMs 🌱
  ☆77Updated 2 weeks ago
• BerivanIsik / sparse-random-networks
  Implementation of the FedPM framework by the authors of the ICLR 2023 paper "Sparse Random Networks for Communication-Efficient Federated…
  ☆29Updated last year
• AmberLJC / FLsystem-paper
  Federated Learning Systems Paper List
  ☆68Updated 9 months ago
• llm-eff / FedPepTAO
  ☆31Updated 8 months ago
• kimihe / Octo
  Create tiny ML systems for on-device learning.
  ☆20Updated 3 years ago
• Shiweiliuiiiiiii / In-Time-Over-Parameterization
  [ICML 2021] "Do We Actually Need Dense Over-Parameterization? In-Time Over-Parameterization in Sparse Training" by Shiwei Liu, Lu Yin, De…
  ☆46Updated last year
• usc-isi / PipeEdge
  PipeEdge: Pipeline Parallelism for Large-Scale Model Inference on Heterogeneous Edge Devices
  ☆27Updated 9 months ago
• txsun1997 / awesome-early-exiting
  A curated list of Early Exiting papers, benchmarks, and misc.
  ☆95Updated last year
• SonyResearch / MocoSFL
  Official Repository for MocoSFL (accepted by ICLR '23, notable 5%)
  ☆52Updated last year
• OPTML-Group / DeepZero
  [ICLR'24] "DeepZero: Scaling up Zeroth-Order Optimization for Deep Model Training" by Aochuan Chen*, Yimeng Zhang*, Jinghan Jia, James Di…
  ☆40Updated last month
• git-disl / scale-fl
  Code for ScaleFL
  ☆29Updated last year
• LiuXiaoxuanPKU / GACT-ICML
  ☆41Updated 2 years ago
• tonyzhao-jt / LLM-PQ
  Official Repo for "LLM-PQ: Serving LLM on Heterogeneous Clusters with Phase-Aware Partition and Adaptive Quantization"
  ☆26Updated 8 months ago