HazyResearch / structured-nets
Structured matrices for compressing neural networks
☆67Updated last year
Related projects ⓘ
Alternatives and complementary repositories for structured-nets
- Code for the article "What if Neural Networks had SVDs?", to be presented as a spotlight paper at NeurIPS 2020.☆69Updated 3 months ago
- Estimating Gradients for Discrete Random Variables by Sampling without Replacement☆39Updated 4 years ago
- Code for the Thermodynamic Variational Objective☆26Updated 2 years ago
- Pytorch implementation of preconditioned stochastic gradient descent (affine group preconditioner, low-rank approximation preconditioner …☆110Updated 3 weeks ago
- Monotone operator equilibrium networks☆51Updated 4 years ago
- CUDA kernels for generalized matrix-multiplication in PyTorch☆79Updated 3 years ago
- This repository is no longer maintained. Check☆82Updated 4 years ago
- 👩 Pytorch and Jax code for the Madam optimiser.☆50Updated 3 years ago
- Easy-to-use AdaHessian optimizer (PyTorch)☆77Updated 3 years ago
- A custom PyTorch layer that is capable of implementing extremely wide and sparse linear layers efficiently☆48Updated 10 months ago
- Repository containing Pytorch code for EKFAC and K-FAC perconditioners.☆140Updated last year
- Limitations of the Empirical Fisher Approximation☆45Updated 4 years ago
- ☆49Updated 4 years ago
- Reparameterize your PyTorch modules☆71Updated 3 years ago
- ☆36Updated 3 years ago
- Efficient Riemannian Optimization on Stiefel Manifold via Cayley Transform☆36Updated 5 years ago
- Official code repository of the paper Linear Transformers Are Secretly Fast Weight Programmers.☆99Updated 3 years ago
- 🧀 Pytorch code for the Fromage optimiser.☆122Updated 3 months ago
- PyTorch-SSO: Scalable Second-Order methods in PyTorch☆141Updated last year
- PyTorch utilities for ML, specifically speech☆13Updated 9 months ago
- Pytorch implementation of the Power Spherical distribution☆73Updated 3 months ago
- [AAAI 2020 Oral] Low-variance Black-box Gradient Estimates for the Plackett-Luce Distribution☆36Updated 3 years ago
- ☆97Updated 2 years ago
- DeepOBS: A Deep Learning Optimizer Benchmark Suite☆103Updated 10 months ago
- Pytorch Implemetation for our NAACL2019 Paper "Riemannian Normalizing Flow on Variational Wasserstein Autoencoder for Text Modeling" http…☆62Updated 4 years ago
- Distributed K-FAC Preconditioner for PyTorch☆80Updated this week
- ☆158Updated 3 months ago
- Code for "Training Deep Energy-Based Models with f-Divergence Minimization" ICML 2020☆35Updated last year
- Experiment code for "Randomized Automatic Differentiation"☆67Updated 4 years ago
- ☆31Updated 4 years ago