lightonai / dfa-scales-to-modern-deep-learning
Study on the applicability of Direct Feedback Alignment to neural view synthesis, recommender systems, geometric learning, and natural language processing.
☆87Updated 2 years ago
Alternatives and similar repositories for dfa-scales-to-modern-deep-learning:
Users that are interested in dfa-scales-to-modern-deep-learning are comparing it to the libraries listed below
- Code for our paper on best practices to train neural networks with direct feedback alignment (DFA).☆21Updated 5 years ago
- PyTorch-based code for training fully-connected and convolutional networks using backpropagation (BP), feedback alignment (FA), direct fe…☆66Updated 4 years ago
- Updates of Equilibrium Prop Match Gradients of Backprop Through Time in an RNN with Static Input (NeurIPS 2019)☆12Updated last year
- Python implementation of the methods in Meulemans et al. 2020 - A Theoretical Framework For Target Propagation☆32Updated 4 months ago
- Fully documented Pytorch implementation of the Equilibrium Propagation algorithm.☆33Updated 5 years ago
- Experiments with Direct Feedback Alignment training scheme for DNNs☆31Updated 8 years ago
- Automatic Hebbian learning in multi-layer convolutional networks with PyTorch, by expressing Hebbian plasticity rules as gradients☆37Updated last year
- ☆12Updated 3 years ago
- Padé Activation Units: End-to-end Learning of Activation Functions in Deep Neural Network☆64Updated 4 years ago
- 🧀 Pytorch code for the Fromage optimiser.☆123Updated 8 months ago
- Structured matrices for compressing neural networks☆66Updated last year
- Computing the eigenvalues of Neural Tangent Kernel and Conjugate Kernel (aka NNGP kernel) over the boolean cube☆48Updated 5 years ago
- Implementation of feedback alignment learning in PyTorch☆30Updated last year
- Hessian spectral density estimation in TF and Jax☆122Updated 4 years ago
- Limitations of the Empirical Fisher Approximation☆47Updated 3 weeks ago
- Deep Learning without Weight Transport☆34Updated 5 years ago
- ☆27Updated 5 years ago
- Usable implementation of Emerging Symbol Binding Network (ESBN), in Pytorch☆24Updated 4 years ago
- BioTorch is a PyTorch framework specializing in biologically plausible learning algorithms☆48Updated last year
- Memory efficient MAML using gradient checkpointing☆84Updated 5 years ago
- Public code for Illing, Ventura, Bellec & Gerstner 2021: Local plasticity rules can learn deep representations using self-supervised cont…☆24Updated 11 months ago
- "Towards Scaling Difference Target Propagation by Learning Backprop Targets" (ICML 2022)☆12Updated 2 years ago
- PyTorch-SSO: Scalable Second-Order methods in PyTorch☆145Updated last year
- ☆13Updated 3 years ago
- Estimating Gradients for Discrete Random Variables by Sampling without Replacement☆40Updated 5 years ago
- Experiments for the paper "Exponential expressivity in deep neural networks through transient chaos"☆70Updated 8 years ago
- Reparameterize your PyTorch modules☆70Updated 4 years ago
- codebase for "A Theory of the Inductive Bias and Generalization of Kernel Regression and Wide Neural Networks"☆50Updated last year
- Experiments for Meta-Learning Symmetries by Reparameterization☆56Updated 3 years ago
- Regularization, Neural Network Training Dynamics☆14Updated 5 years ago