Code accompanying the NeurIPS 2020 paper: WoodFisher (Singh & Alistarh, 2020)
☆53Mar 8, 2021Updated 5 years ago
Alternatives and similar repositories for WoodFisher
Users that are interested in WoodFisher are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Code for ICML 2022 paper "SPDY: Accurate Pruning with Speedup Guarantees"☆20May 3, 2023Updated 2 years ago
- ☆16Sep 27, 2023Updated 2 years ago
- Revisiting Parameter Sharing for Automatic Neural Channel Number Search, NeurIPS 2020☆22Nov 15, 2020Updated 5 years ago
- Official Code of The Combinatorial Brain Surgeon: Pruning Weights That Cancel One Another in Neural Networks[ICML2022]☆17Sep 20, 2022Updated 3 years ago
- Gradient-based Hyperparameter Optimization Over Long Horizons☆14Sep 29, 2021Updated 4 years ago
- Codes for Layer-wise Optimal Brain Surgeon☆79Nov 22, 2018Updated 7 years ago
- ☆11Jun 2, 2021Updated 4 years ago
- Tilted Empirical Risk Minimization (ICLR '21)☆61Nov 10, 2023Updated 2 years ago
- ☆12Oct 9, 2023Updated 2 years ago
- Implementation of the article Online Structured Laplace Approximations For Overcoming Catastrophic Forgetting (https://arxiv.org/pdf/1805…☆10Feb 1, 2019Updated 7 years ago
- PyTorch implementation of Hessian Free optimisation☆43Dec 19, 2019Updated 6 years ago
- Mamba support for transformer lens☆19Sep 17, 2024Updated last year
- Pytorch implementation of our paper accepted by NeurIPS 2022 -- Learning Best Combination for Efficient N:M Sparsity☆22Jan 13, 2023Updated 3 years ago
- Efficient Riemannian Optimization on Stiefel Manifold via Cayley Transform☆45Apr 26, 2019Updated 6 years ago
- Code for the paper "Evading Black-box Classifiers Without Breaking Eggs" [SaTML 2024]☆21Apr 15, 2024Updated last year
- Providing the answer to "How to do patching on all available SAEs on GPT-2?". It is an official repository of the implementation of the p…☆13Jan 26, 2025Updated last year
- ☆14Mar 5, 2021Updated 5 years ago
- ☆244Nov 9, 2022Updated 3 years ago
- Repository for Sparse Finetuning of LLMs via modified version of the MosaicML llmfoundry☆42Jan 15, 2024Updated 2 years ago
- Principled learning method for Wasserstein distributionally robust optimization with local perturbations (ICML 2020)☆21Mar 24, 2023Updated 3 years ago
- Gradients as Features for Deep Representation Learning☆43Mar 8, 2020Updated 6 years ago
- A Generic Multi-classifier Paradigm forIncremental Learning☆11Aug 22, 2020Updated 5 years ago
- Code for "Federated Accelerated Stochastic Gradient Descent" (NeurIPS 2020)☆15Jun 7, 2021Updated 4 years ago
- Code for data-aware compression of DeepSeek models☆71Dec 11, 2025Updated 3 months ago
- ADAHESSIAN: An Adaptive Second Order Optimizer for Machine Learning☆284Feb 27, 2023Updated 3 years ago
- Block Sparse movement pruning☆83Nov 26, 2020Updated 5 years ago
- [ICML2022] Training Your Sparse Neural Network Better with Any Mask. Ajay Jaiswal, Haoyu Ma, Tianlong Chen, ying Ding, and Zhangyang Wang☆30Jul 24, 2022Updated 3 years ago
- Code for "Training Neural Networks with Fixed Sparse Masks" (NeurIPS 2021).☆59Jan 14, 2022Updated 4 years ago
- Soft Threshold Weight Reparameterization for Learnable Sparsity☆91Feb 15, 2023Updated 3 years ago
- ☆83Jan 15, 2020Updated 6 years ago
- {KFAC,EKFAC,Diagonal,Implicit} Fisher Matrices and finite width NTKs in PyTorch☆221Mar 17, 2026Updated last week
- Code for Self-Tuning Networks (ICLR 2019) https://arxiv.org/abs/1903.03088☆61Jun 18, 2019Updated 6 years ago
- Sparse Autoencoder Training Library☆55May 1, 2025Updated 10 months ago
- ☆31Oct 7, 2021Updated 4 years ago
- Implementation of Effective Sparsification of Neural Networks with Global Sparsity Constraint☆31Mar 24, 2022Updated 4 years ago
- Hessian backpropagation (HBP): PyTorch extension of backpropagation for block-diagonal curvature matrix approximations☆21Mar 25, 2023Updated 2 years ago
- DeepHoyer: Learning Sparser Neural Network with Differentiable Scale-Invariant Sparsity Measures☆32Aug 13, 2020Updated 5 years ago
- ☆48Oct 27, 2019Updated 6 years ago
- ☆17Jul 6, 2020Updated 5 years ago