This is the official implementation of the ICML 2023 paper - Can Forward Gradient Match Backpropagation ?
☆13May 31, 2023Updated 2 years ago
Alternatives and similar repositories for ForwardLocalGradient
Users that are interested in ForwardLocalGradient are comparing it to the libraries listed below
Sorting:
- ACCO: An optimization algorithm for sharded distributed LLM training.☆13May 22, 2025Updated 9 months ago
- Splits Keras with Tensorflow backends into two or more submodels.☆18Feb 20, 2023Updated 3 years ago
- Implementation of "Gradients without backpropagation" paper (https://arxiv.org/abs/2202.08587) using functorch☆114Jun 14, 2023Updated 2 years ago
- ☆11Oct 8, 2020Updated 5 years ago
- ScatNetLight for fast classifications of signals via Scattering Networks☆15Apr 20, 2017Updated 8 years ago
- Simple CIFAR10 ResNet example with JAX.☆23Jun 1, 2021Updated 4 years ago
- [NeurIPS'22] Trap and Replace: Defending Backdoor Attacks by Trapping Them into an Easy-to-Replace Subnetwork. Haotao Wang, Junyuan Hong,…☆15Nov 27, 2023Updated 2 years ago
- Prior Knowledge Guided Unsupervised Domain Adaptation (ECCV 2022)☆17Sep 6, 2022Updated 3 years ago
- [ICML‘24] Official code for the paper "Revisiting Zeroth-Order Optimization for Memory-Efficient LLM Fine-Tuning: A Benchmark ".☆124Jul 6, 2025Updated 8 months ago
- This is the official implementation of ScaleBiO: Scalable Bilevel Optimization for LLM Data Reweighting☆24Jul 30, 2024Updated last year
- Reference implementation of DecDTW in PyTorch (ICLR 2023)☆24May 29, 2023Updated 2 years ago
- Test-time adaptation via Nearest neighbor information (TAST), submitted to ICLR'23☆24Jul 11, 2023Updated 2 years ago
- A Python Library for Probabilistic Sparse Coding with Non-Standard Priors and Superpositions☆20Oct 17, 2019Updated 6 years ago
- An alternative EQA paradigm and informative benchmark + models (BMVC 2019, ViGIL 2019 spotlight)☆25Jun 22, 2022Updated 3 years ago
- LISA: Layerwise Importance Sampling for Memory-Efficient Large Language Model Fine-Tuning☆36Apr 4, 2024Updated last year
- Code for "Can We Characterize Tasks Without Labels or Features?" (CVPR 2021)☆11Aug 31, 2021Updated 4 years ago
- [Neurips 2022] “ Back Razor: Memory-Efficient Transfer Learning by Self-Sparsified Backpropogation”, Ziyu Jiang*, Xuxi Chen*, Xueqin Huan…☆19Mar 14, 2023Updated 3 years ago
- Testing Difference Target Propagation (DTP) on MNIST.☆12Oct 12, 2020Updated 5 years ago
- ☆32Aug 28, 2020Updated 5 years ago
- ☆10Jul 6, 2021Updated 4 years ago
- ☆34Jan 25, 2024Updated 2 years ago
- [NeurIPS 2023 - ML for Audio Workshop (Oral)] Zero-shot audio captioning with audio-language model guidance and audio context keywords☆18Nov 30, 2024Updated last year
- ☆11Sep 1, 2024Updated last year
- Source code for "Taming GANs with Lookahead–Minmax", ICLR 2021.☆15Mar 28, 2021Updated 4 years ago
- Workshop on the future of gradient-based machine learning software, NIPS 2017, 2016☆15Jan 8, 2018Updated 8 years ago
- JAX implementation of "Fine-Tuning Language Models with Just Forward Passes"☆19Jun 10, 2023Updated 2 years ago
- Repo to accompany paper on Meta Learning with Implicit Gradients (NeurIPS 2019)☆60Jan 19, 2020Updated 6 years ago
- ☆24Apr 29, 2022Updated 3 years ago
- Implementations of the algorithms described in the paper: On the Convergence Theory for Hessian-Free Bilevel Algorithms.☆11Nov 1, 2024Updated last year
- [ICLR'24] "DeepZero: Scaling up Zeroth-Order Optimization for Deep Model Training" by Aochuan Chen*, Yimeng Zhang*, Jinghan Jia, James Di…☆71Oct 9, 2024Updated last year
- A repository to introduce the algorithmic information theory. You could learn what is Kolmogorov complexity and why it is important here.☆13Jul 23, 2025Updated 7 months ago
- [NeurIPS 2022] "Randomized Channel Shuffling: Minimal-Overhead Backdoor Attack Detection without Clean Datasets" by Ruisi Cai*, Zhenyu Zh…☆21Oct 1, 2022Updated 3 years ago
- Optimization algorithm which fits a ResNet to CIFAR-10 5x faster than SGD / Adam (with terrible generalization)☆14Oct 20, 2023Updated 2 years ago
- Code for ICLR 2019 paper "Efficient Augmentation via Data Subsampling"☆15Feb 20, 2019Updated 7 years ago
- Experiments with Super-Universal Newton method.☆13Aug 12, 2022Updated 3 years ago
- Repository containing code for blockwise SSL training☆30Oct 13, 2024Updated last year
- The biologically plausible self backpropagation on SNNs and ANNs☆13Aug 27, 2021Updated 4 years ago
- [ICLR 2025] This repository contains the code to reproduce the results from our paper From Sparse Dependence to Sparse Attention: Unveili…☆12Mar 7, 2025Updated last year
- [ICML2024] "FedLMT: Tackling System Heterogeneity of Federated Learning via Low-Rank Model Training with Theoretical Guarantees" by Jiaha…☆14Sep 22, 2024Updated last year