HazyResearch / structured-nets
Structured matrices for compressing neural networks
☆66Updated last year
Alternatives and similar repositories for structured-nets:
Users that are interested in structured-nets are comparing it to the libraries listed below
- Estimating Gradients for Discrete Random Variables by Sampling without Replacement☆40Updated 5 years ago
- Code for the article "What if Neural Networks had SVDs?", to be presented as a spotlight paper at NeurIPS 2020.☆74Updated 8 months ago
- CUDA kernels for generalized matrix-multiplication in PyTorch☆79Updated 3 years ago
- Reparameterize your PyTorch modules☆70Updated 4 years ago
- Code for the paper: "Tensor Programs II: Neural Tangent Kernel for Any Architecture"☆106Updated 4 years ago
- Efficient Riemannian Optimization on Stiefel Manifold via Cayley Transform☆38Updated 5 years ago
- 👩 Pytorch and Jax code for the Madam optimiser.☆51Updated 4 years ago
- Easy-to-use AdaHessian optimizer (PyTorch)☆78Updated 4 years ago
- Code for the Thermodynamic Variational Objective☆26Updated 2 years ago
- ☆49Updated 4 years ago
- This repository is no longer maintained. Check☆81Updated 4 years ago
- ☆36Updated 3 years ago
- A custom PyTorch layer that is capable of implementing extremely wide and sparse linear layers efficiently☆49Updated last year
- Limitations of the Empirical Fisher Approximation☆47Updated last month
- Monotone operator equilibrium networks☆51Updated 4 years ago
- Pytorch implementation of the Power Spherical distribution☆74Updated 8 months ago
- Tensorflow implementation and notebooks for Implicit Maximum Likelihood Estimation☆67Updated 3 years ago
- Repository containing Pytorch code for EKFAC and K-FAC perconditioners.☆142Updated last year
- Experiment code for "Randomized Automatic Differentiation"☆66Updated 4 years ago
- Butterfly matrix multiplication in PyTorch☆169Updated last year
- Official code repository of the paper Linear Transformers Are Secretly Fast Weight Programmers.☆104Updated 3 years ago
- 🧀 Pytorch code for the Fromage optimiser.☆123Updated 9 months ago
- Pytorch library for factorized L0-based pruning.☆45Updated last year
- Distributed K-FAC Preconditioner for PyTorch☆85Updated this week
- Padé Activation Units: End-to-end Learning of Activation Functions in Deep Neural Network☆64Updated 4 years ago
- The official repository for our paper "The Devil is in the Detail: Simple Tricks Improve Systematic Generalization of Transformers". We s…☆67Updated 2 years ago
- Implementation of "Variational Dropout and the Local Reparameterization Trick" paper with Pytorch☆49Updated 7 years ago
- Study on the applicability of Direct Feedback Alignment to neural view synthesis, recommender systems, geometric learning, and natural la…☆87Updated 2 years ago
- Optimization with orthogonal constraints and on general manifolds☆128Updated 4 years ago
- TensorFlow implementation of "noisy K-FAC" and "noisy EK-FAC".☆60Updated 6 years ago