lightonai / dfa-scales-to-modern-deep-learningLinks
Study on the applicability of Direct Feedback Alignment to neural view synthesis, recommender systems, geometric learning, and natural language processing.
☆88Updated 3 years ago
Alternatives and similar repositories for dfa-scales-to-modern-deep-learning
Users that are interested in dfa-scales-to-modern-deep-learning are comparing it to the libraries listed below
Sorting:
- Fully documented Pytorch implementation of the Equilibrium Propagation algorithm.☆35Updated 5 years ago
- 🧀 Pytorch code for the Fromage optimiser.☆125Updated last year
- Structured matrices for compressing neural networks☆67Updated last year
- Experiments for Meta-Learning Symmetries by Reparameterization☆56Updated 4 years ago
- Python implementation of the methods in Meulemans et al. 2020 - A Theoretical Framework For Target Propagation☆32Updated 8 months ago
- Updates of Equilibrium Prop Match Gradients of Backprop Through Time in an RNN with Static Input (NeurIPS 2019)☆14Updated last year
- Memory efficient MAML using gradient checkpointing☆85Updated 5 years ago
- Official code repository of the paper Linear Transformers Are Secretly Fast Weight Programmers.☆105Updated 4 years ago
- Implementation of "Gradients without backpropagation" paper (https://arxiv.org/abs/2202.08587) using functorch☆110Updated 2 years ago
- [AAAI 2020 Oral] Low-variance Black-box Gradient Estimates for the Plackett-Luce Distribution☆38Updated 4 years ago
- Computing the eigenvalues of Neural Tangent Kernel and Conjugate Kernel (aka NNGP kernel) over the boolean cube☆47Updated 5 years ago
- Padé Activation Units: End-to-end Learning of Activation Functions in Deep Neural Network☆63Updated 4 years ago
- Neural Turing Machines in pytorch☆48Updated 3 years ago
- Implementation of deep implicit attention in PyTorch☆65Updated 3 years ago
- codebase for "A Theory of the Inductive Bias and Generalization of Kernel Regression and Wide Neural Networks"☆49Updated 2 years ago
- Monotone operator equilibrium networks☆53Updated 5 years ago
- Limitations of the Empirical Fisher Approximation☆47Updated 4 months ago
- Spectral Tensor Train Parameterization of Deep Learning Layers☆15Updated 4 years ago
- Hessian spectral density estimation in TF and Jax☆123Updated 4 years ago
- Official code for Coupled Oscillatory RNN (ICLR 2021, Oral)☆45Updated 3 years ago
- Code for the article "What if Neural Networks had SVDs?", to be presented as a spotlight paper at NeurIPS 2020.☆75Updated 11 months ago
- ☆67Updated 6 years ago
- PyTorch-SSO: Scalable Second-Order methods in PyTorch☆147Updated last year
- Code for the paper: "Tensor Programs II: Neural Tangent Kernel for Any Architecture"☆105Updated 4 years ago
- The original code for the paper "How to train your MAML" along with a replication of the original "Model Agnostic Meta Learning" (MAML) p…☆41Updated 4 years ago
- A custom PyTorch layer that is capable of implementing extremely wide and sparse linear layers efficiently☆50Updated last year
- Fast Discounted Cumulative Sums in PyTorch☆96Updated 3 years ago
- 👩 Pytorch and Jax code for the Madam optimiser.☆51Updated 4 years ago
- ☆49Updated 4 years ago
- ☆133Updated 4 years ago