lightonai / dfa-scales-to-modern-deep-learning
Study on the applicability of Direct Feedback Alignment to neural view synthesis, recommender systems, geometric learning, and natural language processing.
☆85Updated 2 years ago
Related projects ⓘ
Alternatives and complementary repositories for dfa-scales-to-modern-deep-learning
- Code for our paper on best practices to train neural networks with direct feedback alignment (DFA).☆22Updated 5 years ago
- PyTorch-based code for training fully-connected and convolutional networks using backpropagation (BP), feedback alignment (FA), direct fe…☆63Updated 3 years ago
- Experiments with Direct Feedback Alignment training scheme for DNNs☆31Updated 7 years ago
- Implementation of feedback alignment learning in PyTorch☆29Updated last year
- Fully documented Pytorch implementation of the Equilibrium Propagation algorithm.☆31Updated 4 years ago
- 🧀 Pytorch code for the Fromage optimiser.☆122Updated 4 months ago
- Computing the eigenvalues of Neural Tangent Kernel and Conjugate Kernel (aka NNGP kernel) over the boolean cube☆47Updated 5 years ago
- Updates of Equilibrium Prop Match Gradients of Backprop Through Time in an RNN with Static Input (NeurIPS 2019)☆12Updated 8 months ago
- Python implementation of the methods in Meulemans et al. 2020 - A Theoretical Framework For Target Propagation☆30Updated 3 weeks ago
- PyTorch-SSO: Scalable Second-Order methods in PyTorch☆142Updated last year
- ☆15Updated 4 years ago
- Hessian spectral density estimation in TF and Jax☆115Updated 4 years ago
- Deep Learning without Weight Transport☆34Updated 5 years ago
- Automatic Hebbian learning in multi-layer convolutional networks with PyTorch, by expressing Hebbian plasticity rules as gradients☆37Updated last year
- ☆27Updated 5 years ago
- Code for the article "What if Neural Networks had SVDs?", to be presented as a spotlight paper at NeurIPS 2020.☆69Updated 3 months ago
- Code for the Thermodynamic Variational Objective☆26Updated 2 years ago
- BioTorch is a PyTorch framework specializing in biologically plausible learning algorithms☆45Updated 8 months ago
- Limitations of the Empirical Fisher Approximation☆45Updated 4 years ago
- Public code for Illing, Ventura, Bellec & Gerstner 2021: Local plasticity rules can learn deep representations using self-supervised cont…☆24Updated 7 months ago
- Estimating Gradients for Discrete Random Variables by Sampling without Replacement☆39Updated 4 years ago
- [AAAI 2020 Oral] Low-variance Black-box Gradient Estimates for the Plackett-Luce Distribution☆36Updated 3 years ago
- Easy-to-use AdaHessian optimizer (PyTorch)☆77Updated 4 years ago
- Experiments for Meta-Learning Symmetries by Reparameterization☆56Updated 3 years ago
- Implementations and checkpoints for ResNet, Wide ResNet, ResNeXt, ResNet-D, and ResNeSt in JAX (Flax).☆104Updated 2 years ago
- codebase for "A Theory of the Inductive Bias and Generalization of Kernel Regression and Wide Neural Networks"☆49Updated last year
- paper lists and information on mean-field theory of deep learning☆75Updated 5 years ago
- A lightweight and flexible framework for Hebbian learning in PyTorch.☆79Updated 8 months ago
- Code for the paper: "Tensor Programs II: Neural Tangent Kernel for Any Architecture"☆97Updated 4 years ago
- Code to accompany the paper Radial Bayesian Neural Networks: Beyond Discrete Support In Large-Scale Bayesian Deep Learning☆33Updated 4 years ago