Implementation of "Gradients without backpropagation" paper (https://arxiv.org/abs/2202.08587) using functorch
☆114Jun 14, 2023Updated 3 years ago
Alternatives and similar repositories for fwdgrad
Users that are interested in fwdgrad are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This is the official implementation of the ICML 2023 paper - Can Forward Gradient Match Backpropagation ?☆13May 31, 2023Updated 3 years ago
- ☆12Feb 23, 2022Updated 4 years ago
- Rejection-minimal, non-reversible, and continuous-time samplers☆12Nov 14, 2025Updated 8 months ago
- [ICLR'24] "DeepZero: Scaling up Zeroth-Order Optimization for Deep Model Training" by Aochuan Chen*, Yimeng Zhang*, Jinghan Jia, James Di…☆72Oct 9, 2024Updated last year
- Hessian backpropagation (HBP): PyTorch extension of backpropagation for block-diagonal curvature matrix approximations☆22Mar 25, 2023Updated 3 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- ZORB: A Derivative-Free Backpropagation Algorithm for Neural Networks☆22Nov 17, 2020Updated 5 years ago
- A differentiation API for PyTorch☆30Jun 21, 2020Updated 6 years ago
- Benchmarking various AD tools.☆112May 19, 2024Updated 2 years ago
- Simple reimplementation of Maximum Density Divergence for Unsupervised Domain Adaptation (https://arxiv.org/abs/2004.12615) in PyTorch Li…☆26Apr 13, 2021Updated 5 years ago
- "Stochasticity in Neural ODEs: An Empirical Study". Experiments from the paper☆13Apr 27, 2020Updated 6 years ago
- Distributed Reinforcement Learning accelerated by Lightning Fabric☆437Jul 13, 2026Updated last week
- [ICML 2023] This project is the official implementation of our accepted ICML 2023 paper BiBench: Benchmarking and Analyzing Network Binar…☆56Mar 4, 2024Updated 2 years ago
- ☆10Nov 1, 2022Updated 3 years ago
- A Julia library of positivity-preserving time integration methods☆19Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Execution framework for multi-task model parallelism. Enables the training of arbitrarily large models with a single GPU, with linear spe…☆21Aug 13, 2023Updated 2 years ago
- Graph matching and clustering by comparing heat kernels via optimal transport.☆26Dec 8, 2022Updated 3 years ago
- Sparse Autoencoders (SAE) vs CLIP fine-tuning fun.☆18Dec 19, 2024Updated last year
- ☆12Oct 9, 2023Updated 2 years ago
- LISA: Layerwise Importance Sampling for Memory-Efficient Large Language Model Fine-Tuning☆38Apr 4, 2024Updated 2 years ago
- PEP 503 repository index for jax[cuda]☆21Jan 14, 2025Updated last year
- Relevent code snippets for the digital optical neural network project in Dirk Englund's group☆22Mar 3, 2020Updated 6 years ago
- Forward Pass Learning and Inference Library, for neural networks and general intelligence, Signal Propagation (sigprop)☆57Mar 24, 2023Updated 3 years ago
- ☆30Dec 28, 2021Updated 4 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ICIAP2022 - Learning Semantics for Visual Place Recognition through Multi-Scale Attention☆16May 10, 2022Updated 4 years ago
- Siamese Capsule Networks for Face Verification☆11Mar 22, 2019Updated 7 years ago
- Python library for Bayesian Autoencoders☆13Jun 10, 2022Updated 4 years ago
- channel pruning for accelerating very deep neural networks☆13Mar 8, 2021Updated 5 years ago
- ☆10Jul 6, 2021Updated 5 years ago
- [ACL'22] Training-free Neural Architecture Search for RNNs and Transformers☆14May 26, 2024Updated 2 years ago
- This framework implements key experiments on the sparse double descent phenomenon (ICML 2022).☆15Dec 13, 2022Updated 3 years ago
- ☆21Nov 16, 2018Updated 7 years ago
- Automatically modelling and distilling knowledge within AI. In other words, summarising the AI research firehose.☆25Mar 15, 2019Updated 7 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- lua apply function for cutorch☆17Jan 5, 2017Updated 9 years ago
- Website☆12Jul 12, 2026Updated last week
- ☆10Sep 5, 2024Updated last year
- BESA is a differentiable weight pruning technique for large language models.☆17Mar 4, 2024Updated 2 years ago
- Generate qualitative color palettes optimized for dinstictiveness☆23Jun 23, 2026Updated 3 weeks ago
- ☆28Mar 13, 2025Updated last year
- Coherence boosting: When your pretrained language model is not paying enough attention (ACL 2022) https://arxiv.org/abs/2110.08294☆15Apr 23, 2023Updated 3 years ago