lightonai / dfa-scales-to-modern-deep-learningLinks
Study on the applicability of Direct Feedback Alignment to neural view synthesis, recommender systems, geometric learning, and natural language processing.
☆89Updated 3 years ago
Alternatives and similar repositories for dfa-scales-to-modern-deep-learning
Users that are interested in dfa-scales-to-modern-deep-learning are comparing it to the libraries listed below
Sorting:
- 🧀 Pytorch code for the Fromage optimiser.☆129Updated last year
- Fully documented Pytorch implementation of the Equilibrium Propagation algorithm.☆39Updated 6 years ago
- Structured matrices for compressing neural networks☆67Updated 2 years ago
- PyTorch-SSO: Scalable Second-Order methods in PyTorch☆148Updated 2 years ago
- Official code for Coupled Oscillatory RNN (ICLR 2021, Oral)☆53Updated 4 years ago
- Updates of Equilibrium Prop Match Gradients of Backprop Through Time in an RNN with Static Input (NeurIPS 2019)☆14Updated last year
- Official code repository of the paper Linear Transformers Are Secretly Fast Weight Programmers.☆111Updated 4 years ago
- Official code for UnICORNN (ICML 2021)☆28Updated 4 years ago
- ☆50Updated 5 years ago
- Memory efficient MAML using gradient checkpointing☆86Updated 6 years ago
- Keras implementation of Legendre Memory Units☆214Updated last month
- Code for the paper "Predictive Coding Approximates Backprop along Arbitrary Computation Graphs"☆167Updated 5 years ago
- [AAAI 2020 Oral] Low-variance Black-box Gradient Estimates for the Plackett-Luce Distribution☆39Updated 5 years ago
- Deep Learning without Weight Transport☆36Updated 6 years ago
- Easy-to-use AdaHessian optimizer (PyTorch)☆79Updated 5 years ago
- Code for our paper on best practices to train neural networks with direct feedback alignment (DFA).☆21Updated 6 years ago
- Estimating Gradients for Discrete Random Variables by Sampling without Replacement☆40Updated 5 years ago
- Very deep VAEs in JAX/Flax☆46Updated 4 years ago
- Padé Activation Units: End-to-end Learning of Activation Functions in Deep Neural Network☆64Updated 4 years ago
- Neural Turing Machines in pytorch☆48Updated 4 years ago
- Code for the Thermodynamic Variational Objective☆26Updated 3 years ago
- Experiment code for "Randomized Automatic Differentiation"☆67Updated 5 years ago
- Computing the eigenvalues of Neural Tangent Kernel and Conjugate Kernel (aka NNGP kernel) over the boolean cube☆48Updated 6 years ago
- Code for the article "What if Neural Networks had SVDs?", to be presented as a spotlight paper at NeurIPS 2020.☆77Updated last year
- ☆100Updated 4 years ago
- Fast Discounted Cumulative Sums in PyTorch☆97Updated 4 years ago
- Pytorch implementation of preconditioned stochastic gradient descent (Kron and affine preconditioner, low-rank approximation precondition…☆191Updated this week
- The original code for the paper "How to train your MAML" along with a replication of the original "Model Agnostic Meta Learning" (MAML) p…☆41Updated 5 years ago
- ☆68Updated 6 years ago
- A custom PyTorch layer that is capable of implementing extremely wide and sparse linear layers efficiently☆51Updated 2 years ago