varungohil / Generalizing-Lottery-Tickets
This repository contains code to replicate the experiments given in NeurIPS 2019 paper "One ticket to win them all: generalizing lottery ticket initializations across datasets and optimizers"
☆51Updated 9 months ago
Alternatives and similar repositories for Generalizing-Lottery-Tickets:
Users that are interested in Generalizing-Lottery-Tickets are comparing it to the libraries listed below
- Code for "Picking Winning Tickets Before Training by Preserving Gradient Flow" https://openreview.net/pdf?id=SkgsACVKPH☆103Updated 5 years ago
- ☆39Updated 5 years ago
- Lookahead: A Far-sighted Alternative of Magnitude-based Pruning (ICLR 2020)☆33Updated 4 years ago
- Code for Sanity-Checking Pruning Methods: Random Tickets can Win the Jackpot☆42Updated 4 years ago
- ☆70Updated 5 years ago
- Gradient Starvation: A Learning Proclivity in Neural Networks☆61Updated 4 years ago
- This repo contains the code used for NeurIPS 2019 paper "Asymmetric Valleys: Beyond Sharp and Flat Local Minima".☆14Updated 5 years ago
- Code for "Supermasks in Superposition"☆121Updated last year
- Compressing Neural Networks using the Variational Information Bottleneck☆66Updated 2 years ago
- Code for the paper "Understanding Generalization through Visualizations"☆60Updated 4 years ago
- ☆144Updated 2 years ago
- Zero-Shot Knowledge Distillation in Deep Networks☆65Updated 3 years ago
- [JMLR] TRADES + random smoothing for certifiable robustness☆14Updated 4 years ago
- SNIP: SINGLE-SHOT NETWORK PRUNING☆30Updated last month
- [ICLR 2020] ”Triple Wins: Boosting Accuracy, Robustness and Efficiency Together by Enabling Input-Adaptive Inference“☆24Updated 3 years ago
- SNIP: SINGLE-SHOT NETWORK PRUNING BASED ON CONNECTION SENSITIVITY☆113Updated 5 years ago
- Rethinking Bias-Variance Trade-off for Generalization of Neural Networks☆49Updated 4 years ago
- [NeurIPS'2019] Shupeng Gui, Haotao Wang, Haichuan Yang, Chen Yu, Zhangyang Wang, Ji Liu, “Model Compression with Adversarial Robustness: …☆49Updated 3 years ago
- Soft Threshold Weight Reparameterization for Learnable Sparsity☆89Updated 2 years ago
- ☆83Updated 5 years ago
- Good Subnetworks Provably Exist: Pruning via Greedy Forward Selection☆21Updated 4 years ago
- PyTorch implementation of "STNs" and "Delta-STNs".☆50Updated 4 years ago
- "Layer-wise Adaptive Rate Scaling" in PyTorch☆86Updated 4 years ago
- ☆58Updated 2 years ago
- Unofficial pytorch implementation of Born-Again Neural Networks.☆53Updated 4 years ago
- Codebase for the paper "A Gradient Flow Framework for Analyzing Network Pruning"☆21Updated 4 years ago
- [CVPR 2021] "The Lottery Tickets Hypothesis for Supervised and Self-supervised Pre-training in Computer Vision Models" Tianlong Chen, Jon…☆69Updated 2 years ago
- Delta Orthogonal Initialization for PyTorch☆18Updated 6 years ago
- Neuron Merging: Compensating for Pruned Neurons (NeurIPS 2020)☆42Updated 4 years ago
- Tensorflow implementation of "Meta Dropout: Learning to Perturb Latent Features for Generalization" (ICLR 2020)☆27Updated 4 years ago