ihsuy / Train-by-Reconnect
Official code for the NeurIPS 2020 paper Train by Reconnect: Decoupling Locations of Weights from Their Values by Yushi Qiu and Reiji Suda.
☆9Updated 4 years ago
Alternatives and similar repositories for Train-by-Reconnect
Users that are interested in Train-by-Reconnect are comparing it to the libraries listed below
Sorting:
- ☆34Updated 2 years ago
- Efficient Riemannian Optimization on Stiefel Manifold via Cayley Transform☆40Updated 6 years ago
- Efficient reference implementations of the static & dynamic M-FAC algorithms (for pruning and optimization)☆16Updated 3 years ago
- ☆67Updated 5 months ago
- This repository contains PyTorch implementations of various random feature maps for dot product kernels.☆21Updated 10 months ago
- Convolutional Neural Tangent Kernel☆111Updated 5 years ago
- Official repository for "Categorical Normalizing Flows via Continuous Transformations"☆56Updated 4 years ago
- Code for the paper: "Tensor Programs II: Neural Tangent Kernel for Any Architecture"☆106Updated 4 years ago
- Transformers with doubly stochastic attention☆45Updated 2 years ago
- A fusion of a linear layer and a cross entropy loss, written for pytorch in triton.☆67Updated 9 months ago
- Code for paper "Compositional Sculpting of Iterative Generative Processes"☆21Updated last year
- Code accompanying our paper "Feature Learning in Infinite-Width Neural Networks" (https://arxiv.org/abs/2011.14522)☆62Updated 4 years ago
- Pytorch implementation of KFAC and E-KFAC (Natural Gradient).☆132Updated 5 years ago
- Code for the article "What if Neural Networks had SVDs?", to be presented as a spotlight paper at NeurIPS 2020.☆75Updated 9 months ago
- ☆14Updated 2 years ago
- Code for Knowledge-Adaptation Priors based on the NeurIPS 2021 paper by Khan and Swaroop.☆16Updated 3 years ago
- JAX Implementation of Liger Kernels☆9Updated 6 months ago
- PyTorch linear operators for curvature matrices (Hessian, Fisher/GGN, KFAC, ...)☆38Updated 3 weeks ago
- ☆34Updated 5 months ago
- Official release of code for "Oops I Took A Gradient: Scalable Sampling for Discrete Distributions"☆54Updated last year
- Bayesian Optimisation for String Spaces☆24Updated 3 years ago
- Python implementation for Combining Latent Space and Structured Kernels for Bayesian Optimization over Combinatorial Spaces.☆13Updated 3 years ago
- Pytorch library for factorized L0-based pruning.☆45Updated last year
- Repository containing Pytorch code for EKFAC and K-FAC perconditioners.☆142Updated last year
- ☆53Updated 7 months ago
- Source code of "What can linearized neural networks actually say about generalization?☆20Updated 3 years ago
- ☆52Updated last year
- Code for Accelerated Linearized Laplace Approximation for Bayesian Deep Learning (ELLA, NeurIPS 22')☆16Updated 2 years ago
- Easy-to-use AdaHessian optimizer (PyTorch)☆78Updated 4 years ago
- PyTorch implementation for "HyperSPNs: Compact and Expressive Probabilistic Circuits", NeurIPS 2021☆13Updated 3 years ago