HazyResearch / structured-nets
Structured matrices for compressing neural networks
☆67Updated last year
Alternatives and similar repositories for structured-nets:
Users that are interested in structured-nets are comparing it to the libraries listed below
- Code for the article "What if Neural Networks had SVDs?", to be presented as a spotlight paper at NeurIPS 2020.☆72Updated 5 months ago
- CUDA kernels for generalized matrix-multiplication in PyTorch☆79Updated 3 years ago
- Estimating Gradients for Discrete Random Variables by Sampling without Replacement☆39Updated 4 years ago
- Repository containing Pytorch code for EKFAC and K-FAC perconditioners.☆140Updated last year
- Code for the Thermodynamic Variational Objective☆26Updated 2 years ago
- Reparameterize your PyTorch modules☆70Updated 4 years ago
- PyTorch-SSO: Scalable Second-Order methods in PyTorch☆142Updated last year
- This repository is no longer maintained. Check☆81Updated 4 years ago
- Code for the paper: "Tensor Programs II: Neural Tangent Kernel for Any Architecture"☆102Updated 4 years ago
- ☆49Updated 4 years ago
- A custom PyTorch layer that is capable of implementing extremely wide and sparse linear layers efficiently☆48Updated last year
- Tensorflow implementation and notebooks for Implicit Maximum Likelihood Estimation☆67Updated 2 years ago
- Limitations of the Empirical Fisher Approximation☆46Updated 4 years ago
- Code for "Training Deep Energy-Based Models with f-Divergence Minimization" ICML 2020☆36Updated last year
- Monotone operator equilibrium networks☆51Updated 4 years ago
- Pytorch implementation of the Power Spherical distribution☆74Updated 5 months ago
- Efficient Riemannian Optimization on Stiefel Manifold via Cayley Transform☆37Updated 5 years ago
- [AAAI 2020 Oral] Low-variance Black-box Gradient Estimates for the Plackett-Luce Distribution☆37Updated 4 years ago
- Official code repository of the paper Linear Transformers Are Secretly Fast Weight Programmers.☆101Updated 3 years ago
- 🧀 Pytorch code for the Fromage optimiser.☆122Updated 6 months ago
- ☆36Updated 3 years ago
- 👩 Pytorch and Jax code for the Madam optimiser.☆52Updated 3 years ago
- Code for Self-Tuning Networks (ICLR 2019) https://arxiv.org/abs/1903.03088☆53Updated 5 years ago
- PyTorch AutoNEB implementation to identify minimum energy paths, e.g. in neural network loss landscapes☆54Updated 2 years ago
- Pytorch implementation of preconditioned stochastic gradient descent (Kron and affine preconditioner, low-rank approximation precondition…☆146Updated last month
- paper lists and information on mean-field theory of deep learning☆75Updated 5 years ago
- Keras implementation of Deep Wasserstein Embeddings☆47Updated 6 years ago
- Hessian spectral density estimation in TF and Jax☆120Updated 4 years ago
- ☆29Updated 3 years ago
- TensorFlow implementation of "noisy K-FAC" and "noisy EK-FAC".☆60Updated 6 years ago