Lightweight torch implementation of rigl, a sparse-to-sparse optimizer.
☆61Jul 6, 2026Updated 3 months ago
Alternatives and similar repositories for rigl-torch
Users that are interested in rigl-torch are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Reproducing RigL (ICML 2020) as a part of ML Reproducibility Challenge 2020☆29Jan 6, 2022Updated 4 years ago
- [Neurips 2021] Sparse Training via Boosting Pruning Plasticity with Neuroregeneration☆31Feb 11, 2023Updated 3 years ago
- End-to-end training of sparse deep neural networks with little-to-no performance loss.☆340Jan 26, 2023Updated 3 years ago
- ☆14Mar 5, 2021Updated 5 years ago
- Soft Threshold Weight Reparameterization for Learnable Sparsity☆91Feb 15, 2023Updated 3 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Code for "Picking Winning Tickets Before Training by Preserving Gradient Flow" https://openreview.net/pdf?id=SkgsACVKPH☆106Feb 18, 2020Updated 6 years ago
- This repository is the official implementation of the paper Pruning via Iterative Ranking of Sensitivity Statistics and implements novel …☆34May 22, 2023Updated 3 years ago
- [ICML 2021] "Do We Actually Need Dense Over-Parameterization? In-Time Over-Parameterization in Sparse Training" by Shiwei Liu, Lu Yin, De…☆46Nov 11, 2023Updated 2 years ago
- Pytorch implementation of the paper "SNIP: Single-shot Network Pruning based on Connection Sensitivity" by Lee et al.☆110Apr 23, 2019Updated 7 years ago
- [ICLR 2022] The Unreasonable Effectiveness of Random Pruning: Return of the Most Naive Baseline for Sparse Training by Shiwei Liu, Tianlo…☆79Jan 9, 2023Updated 3 years ago
- [IJCAI'22 Survey] Recent Advances on Neural Network Pruning at Initialization.☆59Oct 10, 2023Updated 3 years ago
- Implementation of Effective Sparsification of Neural Networks with Global Sparsity Constraint☆31Mar 24, 2022Updated 4 years ago
- Prospect Pruning: Finding Trainable Weights at Initialization Using Meta-Gradients☆32Mar 30, 2022Updated 4 years ago
- ☆230Jul 25, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Official Pytorch Implementation of Our Paper Accepted at ICLR 2024-- Dynamic Sparse No Training: Training-Free Fine-tuning for Sparse LLM…☆51Apr 9, 2024Updated 2 years ago
- Code for ICML 2021 submission☆35Mar 24, 2021Updated 5 years ago
- Optimizing neural networks via an inverse scale space flow.☆16Jan 30, 2024Updated 2 years ago
- Imitation learning from multiple experts☆13Aug 29, 2022Updated 4 years ago
- Comparison of method "Pruning at initialization prior to training" (Synflow/SNIP/GraSP) in PyTorch☆18May 12, 2024Updated 2 years ago
- ☆19Dec 10, 2021Updated 4 years ago
- Official repository for the paper "Blending Complementary Memory Systems in Hybrid Quadratic-Linear Transformers"☆13Jun 3, 2025Updated last year
- Code for reproducing "AC/DC: Alternating Compressed/DeCompressed Training of Deep Neural Networks" (NeurIPS 2021)☆23Nov 9, 2021Updated 4 years ago
- Code for Sanity-Checking Pruning Methods: Random Tickets can Win the Jackpot☆43Nov 8, 2020Updated 5 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Mathematical consequences of orthogonal weights initialization and regularization in deep learning. Experiments with gain-adjusted orthog…☆17Sep 21, 2019Updated 7 years ago
- ☆33Mar 9, 2022Updated 4 years ago
- Efficient Expert Pruning for Sparse Mixture-of-Experts Language Models: Enhancing Performance and Reducing Inference Costs☆25Nov 11, 2025Updated 11 months ago
- This repository contains a Pytorch implementation of the paper "The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks"…☆351Oct 3, 2023Updated 3 years ago
- ☆13Oct 13, 2025Updated last year
- PyTorch library to facilitate development and standardized evaluation of neural network pruning methods.☆438Jul 7, 2023Updated 3 years ago
- DeepHoyer: Learning Sparser Neural Network with Differentiable Scale-Invariant Sparsity Measures☆32Aug 13, 2020Updated 6 years ago
- This is the implementation of our AAAI2024 paper: BiPFT: Binary Pre-trained Foundation Transformer with Low-rank Estimation of Binarizati…☆10Jul 13, 2024Updated 2 years ago
- ☆13Jul 3, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Lookahead: A Far-sighted Alternative of Magnitude-based Pruning (ICLR 2020)☆32Oct 25, 2020Updated 6 years ago
- ICLR 2021 (spotlight): Graph Convolution with Low-rank Learnable Local Filters☆16Jan 14, 2021Updated 5 years ago
- ☆246Nov 9, 2022Updated 3 years ago
- Repository for the paper Tackling covariate shift with node-based Bayesian neural networks (ICML 2022 oral)☆11Jul 16, 2024Updated 2 years ago
- Implementation of unregularized, l1 regularized and l2 regularized linear regression using numpy and without sklearn☆11Oct 4, 2019Updated 7 years ago
- Dynamical low rank training for neural networks☆11Aug 24, 2023Updated 3 years ago
- Implementation of "Interior Point Solving for LP-based prediction+optimisation" paper in Neurips 2020.☆21May 16, 2024Updated 2 years ago