toshas / sttpLinks
Spectral Tensor Train Parameterization of Deep Learning Layers
☆15Updated 4 years ago
Alternatives and similar repositories for sttp
Users that are interested in sttp are comparing it to the libraries listed below
Sorting:
- Code for the article "What if Neural Networks had SVDs?", to be presented as a spotlight paper at NeurIPS 2020.☆76Updated last year
- Implementations of orthogonal and semi-orthogonal convolutions in the Fourier domain with applications to adversarial robustness☆47Updated 4 years ago
- ☆60Updated 5 years ago
- Efficient Riemannian Optimization on Stiefel Manifold via Cayley Transform☆43Updated 6 years ago
- ☆30Updated 5 years ago
- Monotone operator equilibrium networks☆53Updated 5 years ago
- Optimization with orthogonal constraints and on general manifolds☆130Updated 5 years ago
- ☆54Updated last year
- ☆47Updated 6 years ago
- Adaptive gradient descent without descent☆49Updated 4 years ago
- Code for the ICML 2021 and ICLR 2022 papers: Skew Orthogonal Convolutions, Improved deterministic l2 robustness on CIFAR-10 and CIFAR-100☆18Updated 3 years ago
- Efficient Householder Transformation in PyTorch☆66Updated 4 years ago
- Code base for SRSGD.☆29Updated 5 years ago
- Differentiable Optimizers with Perturbations in Pytorch☆67Updated 4 years ago
- Official Release of "Learning the Stein Discrepancy for Training and Evaluating Energy-Based Models without Sampling"☆49Updated 5 years ago
- [AAAI 2020 Oral] Low-variance Black-box Gradient Estimates for the Plackett-Luce Distribution☆39Updated 4 years ago
- ☆20Updated 5 years ago
- Code for "On the Spectral Bias of Neural Networks", to appear in ICML 2019 (Long Beach, CA).☆113Updated 6 years ago
- Implementation of the models and datasets used in "An Information-theoretic Approach to Distribution Shifts"☆25Updated 3 years ago
- Padé Activation Units: End-to-end Learning of Activation Functions in Deep Neural Network☆63Updated 4 years ago
- ☆64Updated last year
- PyTorch implementation of FIM and empirical FIM☆61Updated 7 years ago
- Code for Knowledge-Adaptation Priors based on the NeurIPS 2021 paper by Khan and Swaroop.☆16Updated 3 years ago
- The official code for Efficient Learning of Generative Models via Finite-Difference Score Matching☆12Updated 2 years ago
- PyTorch implementation of Continuously Indexed Flows paper, with many baseline normalising flows☆31Updated 4 years ago
- A pytorch implementation for the LSTM experiments in the paper: Why Gradient Clipping Accelerates Training: A Theoretical Justification f…☆46Updated 5 years ago
- Code for the paper: "Tensor Programs II: Neural Tangent Kernel for Any Architecture"☆104Updated 5 years ago
- Limitations of the Empirical Fisher Approximation☆48Updated 7 months ago
- Estimating Gradients for Discrete Random Variables by Sampling without Replacement☆40Updated 5 years ago
- ☆36Updated 4 years ago