HazyResearch / structured-nets
Structured matrices for compressing neural networks
☆66Updated last year
Alternatives and similar repositories for structured-nets:
Users that are interested in structured-nets are comparing it to the libraries listed below
- Code for the article "What if Neural Networks had SVDs?", to be presented as a spotlight paper at NeurIPS 2020.☆75Updated 9 months ago
- Estimating Gradients for Discrete Random Variables by Sampling without Replacement☆40Updated 5 years ago
- CUDA kernels for generalized matrix-multiplication in PyTorch☆79Updated 3 years ago
- A custom PyTorch layer that is capable of implementing extremely wide and sparse linear layers efficiently☆49Updated last year
- Easy-to-use AdaHessian optimizer (PyTorch)☆78Updated 4 years ago
- Code for the paper: "Tensor Programs II: Neural Tangent Kernel for Any Architecture"☆106Updated 4 years ago
- Limitations of the Empirical Fisher Approximation☆47Updated 2 months ago
- Repository containing Pytorch code for EKFAC and K-FAC perconditioners.☆142Updated last year
- ☆49Updated 4 years ago
- ☆36Updated 3 years ago
- PyTorch-SSO: Scalable Second-Order methods in PyTorch☆145Updated last year
- Code for the Thermodynamic Variational Objective☆26Updated 2 years ago
- 👩 Pytorch and Jax code for the Madam optimiser.☆51Updated 4 years ago
- Monotone operator equilibrium networks☆51Updated 4 years ago
- ☆33Updated 4 years ago
- This repository is no longer maintained. Check☆81Updated 5 years ago
- Code for Self-Tuning Networks (ICLR 2019) https://arxiv.org/abs/1903.03088☆53Updated 5 years ago
- 🧀 Pytorch code for the Fromage optimiser.☆124Updated 9 months ago
- ☆29Updated 4 years ago
- Efficient Riemannian Optimization on Stiefel Manifold via Cayley Transform☆40Updated 6 years ago
- TensorFlow implementation of "noisy K-FAC" and "noisy EK-FAC".☆60Updated 6 years ago
- Reparameterize your PyTorch modules☆71Updated 4 years ago
- Computing the eigenvalues of Neural Tangent Kernel and Conjugate Kernel (aka NNGP kernel) over the boolean cube☆47Updated 5 years ago
- Differentiable bitonic sorting☆140Updated 4 years ago
- Distributed K-FAC preconditioner for PyTorch☆85Updated last week
- Official code repository of the paper Linear Transformers Are Secretly Fast Weight Programmers.☆105Updated 3 years ago
- ☆60Updated 4 years ago
- Autoregressive Energy Machines☆77Updated 2 years ago
- ☆99Updated 3 years ago
- an implementation of L0 regularization with PyTorch☆57Updated 7 years ago