HazyResearch / structured-netsLinks
Structured matrices for compressing neural networks
☆67Updated 2 years ago
Alternatives and similar repositories for structured-nets
Users that are interested in structured-nets are comparing it to the libraries listed below
Sorting:
- Code for the article "What if Neural Networks had SVDs?", to be presented as a spotlight paper at NeurIPS 2020.☆77Updated last year
- CUDA kernels for generalized matrix-multiplication in PyTorch☆85Updated 4 years ago
- 🧀 Pytorch code for the Fromage optimiser.☆129Updated last year
- Easy-to-use AdaHessian optimizer (PyTorch)☆79Updated 5 years ago
- Estimating Gradients for Discrete Random Variables by Sampling without Replacement☆40Updated 5 years ago
- PyTorch-SSO: Scalable Second-Order methods in PyTorch☆148Updated 2 years ago
- 👩 Pytorch and Jax code for the Madam optimiser.☆53Updated 4 years ago
- ☆50Updated 5 years ago
- Reparameterize your PyTorch modules☆71Updated 5 years ago
- Official code repository of the paper Linear Transformers Are Secretly Fast Weight Programmers.☆111Updated 4 years ago
- Code for the paper: "Tensor Programs II: Neural Tangent Kernel for Any Architecture"☆107Updated 5 years ago
- Repository containing Pytorch code for EKFAC and K-FAC perconditioners.☆152Updated 2 years ago
- A custom PyTorch layer that is capable of implementing extremely wide and sparse linear layers efficiently☆51Updated 2 years ago
- This repository is no longer maintained. Check☆81Updated 5 years ago
- Memory efficient MAML using gradient checkpointing☆86Updated 6 years ago
- Optimization with orthogonal constraints and on general manifolds☆130Updated 5 years ago
- Efficient Riemannian Optimization on Stiefel Manifold via Cayley Transform☆44Updated 6 years ago
- Butterfly matrix multiplication in PyTorch☆178Updated 2 years ago
- Monotone operator equilibrium networks☆54Updated 5 years ago
- Limitations of the Empirical Fisher Approximation☆49Updated 11 months ago
- paper lists and information on mean-field theory of deep learning☆79Updated 6 years ago
- Computing the eigenvalues of Neural Tangent Kernel and Conjugate Kernel (aka NNGP kernel) over the boolean cube☆48Updated 6 years ago
- ☆100Updated 4 years ago
- Convolutional Neural Tangent Kernel☆112Updated 6 years ago
- Code for the Thermodynamic Variational Objective☆26Updated 3 years ago
- Experiments for the paper "Exponential expressivity in deep neural networks through transient chaos"☆74Updated 9 years ago
- Hypergradient descent☆147Updated last year
- Implementation of "Variational Dropout and the Local Reparameterization Trick" paper with Pytorch☆49Updated 8 years ago
- Tensorflow implementation and notebooks for Implicit Maximum Likelihood Estimation☆67Updated 3 years ago
- The original code for the paper "How to train your MAML" along with a replication of the original "Model Agnostic Meta Learning" (MAML) p…☆41Updated 5 years ago