colehawkins / bayesian-tensor-rank-determination
☆12Updated 2 years ago
Related projects ⓘ
Alternatives and complementary repositories for bayesian-tensor-rank-determination
- TedNet: A Pytorch Toolkit for Tensor Decomposition Networks☆91Updated 2 years ago
- Code for the ICML 2021 and ICLR 2022 papers: Skew Orthogonal Convolutions, Improved deterministic l2 robustness on CIFAR-10 and CIFAR-100☆18Updated 2 years ago
- This is the official implementation of the ICML 2023 paper - Can Forward Gradient Match Backpropagation ?☆10Updated last year
- Efficient Riemannian Optimization on Stiefel Manifold via Cayley Transform☆36Updated 5 years ago
- code to show F-Principle in the DNN training☆59Updated 2 years ago
- Implementation of Continuous Sparsification, a method for pruning and ticket search in deep networks☆32Updated 2 years ago
- ☆46Updated 5 years ago
- 😎 A curated list of tensor decomposition resources for model compression.☆22Updated last week
- [IJCAI'22 Survey] Recent Advances on Neural Network Pruning at Initialization.☆57Updated last year
- Implicit networks can be trained efficiently and simply by using Jacobian-free Backprop (JFB).☆34Updated 2 years ago
- Official implementation for the paper "Controlled Sparsity via Constrained Optimization"☆10Updated 2 years ago
- [ICML 2021] "Do We Actually Need Dense Over-Parameterization? In-Time Over-Parameterization in Sparse Training" by Shiwei Liu, Lu Yin, De…☆46Updated last year
- Good Subnetworks Provably Exist: Pruning via Greedy Forward Selection☆21Updated 3 years ago
- ☆8Updated 6 years ago
- SLTrain: a sparse plus low-rank approach for parameter and memory efficient pretraining (NeurIPS 2024)☆24Updated 2 weeks ago
- Lightweight torch implementation of rigl, a sparse-to-sparse optimizer.☆55Updated 3 years ago
- [Neurips 2021] Sparse Training via Boosting Pruning Plasticity with Neuroregeneration☆29Updated last year
- Prospect Pruning: Finding Trainable Weights at Initialization Using Meta-Gradients☆29Updated 2 years ago
- Code for the article "What if Neural Networks had SVDs?", to be presented as a spotlight paper at NeurIPS 2020.☆69Updated 3 months ago
- Distributed K-FAC Preconditioner for PyTorch☆80Updated this week
- [ICLR 2022] "Learning Pruning-Friendly Networks via Frank-Wolfe: One-Shot, Any-Sparsity, and No Retraining" by Lu Miao*, Xiaolong Luo*, T…☆29Updated 2 years ago
- [ICLR-2020] Dynamic Sparse Training: Find Efficient Sparse Network From Scratch With Trainable Masked Layers.☆31Updated 4 years ago
- PyTorch Implementation of the CLIP Algorithm☆12Updated last month
- Implementations of the algorithms described in the paper: On the Convergence Theory for Hessian-Free Bilevel Algorithms.☆10Updated 2 weeks ago
- ☆29Updated 3 years ago
- Pytorch implementation for Decomposed Convolutional Filters Network☆22Updated 4 years ago
- [ICML2022] Training Your Sparse Neural Network Better with Any Mask. Ajay Jaiswal, Haoyu Ma, Tianlong Chen, ying Ding, and Zhangyang Wang☆26Updated 2 years ago
- Visualization of mean field and neural tangent kernel regime☆20Updated 3 months ago
- The code for Differentiable Linearized ADMM (ICML 2019)☆33Updated 5 years ago
- Spectral Tensor Train Parameterization of Deep Learning Layers☆13Updated 3 years ago