lightonai / dfa-scales-to-modern-deep-learning
Study on the applicability of Direct Feedback Alignment to neural view synthesis, recommender systems, geometric learning, and natural language processing.
☆86Updated 2 years ago
Alternatives and similar repositories for dfa-scales-to-modern-deep-learning:
Users that are interested in dfa-scales-to-modern-deep-learning are comparing it to the libraries listed below
- Code for our paper on best practices to train neural networks with direct feedback alignment (DFA).☆21Updated 5 years ago
- Fully documented Pytorch implementation of the Equilibrium Propagation algorithm.☆32Updated 5 years ago
- Updates of Equilibrium Prop Match Gradients of Backprop Through Time in an RNN with Static Input (NeurIPS 2019)☆12Updated 11 months ago
- Implementation of feedback alignment learning in PyTorch☆30Updated last year
- PyTorch-based code for training fully-connected and convolutional networks using backpropagation (BP), feedback alignment (FA), direct fe…☆66Updated 4 years ago
- Python implementation of the methods in Meulemans et al. 2020 - A Theoretical Framework For Target Propagation☆32Updated 4 months ago
- Experiments with Direct Feedback Alignment training scheme for DNNs☆31Updated 8 years ago
- Code for the article "What if Neural Networks had SVDs?", to be presented as a spotlight paper at NeurIPS 2020.☆74Updated 7 months ago
- Structured matrices for compressing neural networks☆66Updated last year
- Official code repository of the paper Linear Transformers Are Secretly Fast Weight Programmers.☆102Updated 3 years ago
- Computing the eigenvalues of Neural Tangent Kernel and Conjugate Kernel (aka NNGP kernel) over the boolean cube☆48Updated 5 years ago
- Reparameterize your PyTorch modules☆70Updated 4 years ago
- Estimating Gradients for Discrete Random Variables by Sampling without Replacement☆40Updated 5 years ago
- 🧀 Pytorch code for the Fromage optimiser.☆123Updated 8 months ago
- ☆49Updated 4 years ago
- Train self-modifying neural networks with neuromodulated plasticity☆76Updated 5 years ago
- A custom PyTorch layer that is capable of implementing extremely wide and sparse linear layers efficiently☆49Updated last year
- ☆12Updated 3 years ago
- Automatic Hebbian learning in multi-layer convolutional networks with PyTorch, by expressing Hebbian plasticity rules as gradients☆37Updated last year
- A lightweight and flexible framework for Hebbian learning in PyTorch.☆82Updated last year
- Deep Learning without Weight Transport☆34Updated 5 years ago
- Hessian spectral density estimation in TF and Jax☆122Updated 4 years ago
- Limitations of the Empirical Fisher Approximation☆47Updated last week
- Easy-to-use AdaHessian optimizer (PyTorch)☆77Updated 4 years ago
- ☆27Updated 5 years ago
- ☆53Updated 7 months ago
- Padé Activation Units: End-to-end Learning of Activation Functions in Deep Neural Network☆64Updated 4 years ago
- ☆24Updated 2 years ago
- Experiments for Meta-Learning Symmetries by Reparameterization☆56Updated 3 years ago
- Usable implementation of Emerging Symbol Binding Network (ESBN), in Pytorch☆24Updated 4 years ago