lightonai / dfa-scales-to-modern-deep-learning
Study on the applicability of Direct Feedback Alignment to neural view synthesis, recommender systems, geometric learning, and natural language processing.
☆86Updated 2 years ago
Alternatives and similar repositories for dfa-scales-to-modern-deep-learning:
Users that are interested in dfa-scales-to-modern-deep-learning are comparing it to the libraries listed below
- Code for our paper on best practices to train neural networks with direct feedback alignment (DFA).☆21Updated 5 years ago
- Experiments with Direct Feedback Alignment training scheme for DNNs☆31Updated 7 years ago
- Implementation of feedback alignment learning in PyTorch☆30Updated last year
- A lightweight and flexible framework for Hebbian learning in PyTorch.☆81Updated 11 months ago
- PyTorch-based code for training fully-connected and convolutional networks using backpropagation (BP), feedback alignment (FA), direct fe…☆64Updated 4 years ago
- Python implementation of the methods in Meulemans et al. 2020 - A Theoretical Framework For Target Propagation☆31Updated 3 months ago
- Automatic Hebbian learning in multi-layer convolutional networks with PyTorch, by expressing Hebbian plasticity rules as gradients☆37Updated last year
- Updates of Equilibrium Prop Match Gradients of Backprop Through Time in an RNN with Static Input (NeurIPS 2019)☆12Updated 10 months ago
- Fully documented Pytorch implementation of the Equilibrium Propagation algorithm.☆32Updated 5 years ago
- ☆27Updated 5 years ago
- ☆12Updated 3 years ago
- Example of Dense Associative Memory training on MNIST☆35Updated 2 years ago
- Public code for Illing, Ventura, Bellec & Gerstner 2021: Local plasticity rules can learn deep representations using self-supervised cont…☆24Updated 10 months ago
- BioTorch is a PyTorch framework specializing in biologically plausible learning algorithms☆47Updated 11 months ago
- Deep Learning without Weight Transport☆34Updated 5 years ago
- PyTorch implementation of linear and convolutional layers with fixed, random feedback weights.☆13Updated 3 years ago
- Code for the paper "Predictive Coding Approximates Backprop along Arbitrary Computation Graphs"☆151Updated 4 years ago
- Padé Activation Units: End-to-end Learning of Activation Functions in Deep Neural Network☆64Updated 3 years ago
- Code for the article "What if Neural Networks had SVDs?", to be presented as a spotlight paper at NeurIPS 2020.☆72Updated 6 months ago
- Structured matrices for compressing neural networks☆66Updated last year
- Hessian spectral density estimation in TF and Jax☆121Updated 4 years ago
- ☆98Updated 3 years ago
- The original code for the paper "How to train your MAML" along with a replication of the original "Model Agnostic Meta Learning" (MAML) p…☆40Updated 4 years ago
- Training Recurrent Neural Networks via Forward Propagation Through Time☆38Updated 3 years ago
- Computing the eigenvalues of Neural Tangent Kernel and Conjugate Kernel (aka NNGP kernel) over the boolean cube☆48Updated 5 years ago
- Official code for Coupled Oscillatory RNN (ICLR 2021, Oral)☆43Updated 3 years ago
- codebase for "A Theory of the Inductive Bias and Generalization of Kernel Regression and Wide Neural Networks"☆50Updated last year
- PyTorch-SSO: Scalable Second-Order methods in PyTorch☆145Updated last year
- Memory efficient MAML using gradient checkpointing☆83Updated 5 years ago
- Limitations of the Empirical Fisher Approximation☆47Updated 4 years ago