landskape-ai / Progressive-PruningLinks
Official pytorch code for "APP: Anytime Progressive Pruning" (DyNN @ ICML, 2022; CLL @ ACML, 2022, SNN @ ICML, 2022 and SlowDNN 2023)
☆16Updated 2 years ago
Alternatives and similar repositories for Progressive-Pruning
Users that are interested in Progressive-Pruning are comparing it to the libraries listed below
Sorting:
- ☆10Updated 3 years ago
- Explores the ideas presented in Deep Ensembles: A Loss Landscape Perspective (https://arxiv.org/abs/1912.02757) by Stanislav Fort, Huiyi …☆65Updated 5 years ago
- ☆75Updated 2 years ago
- A collection of metrics to profile a single deep learning model or compare two different deep learning models☆27Updated last year
- A case study of efficient training of large language models using commodity hardware.☆68Updated 3 years ago
- [ECCV 2022] SuperTickets: Drawing Task-Agnostic Lottery Tickets from Supernets via Jointly Architecture Searching and Parameter Pruning☆21Updated 3 years ago
- Contains code for the paper "Vision Transformers are Robust Learners" (AAAI 2022).☆124Updated 2 years ago
- Implémentation of the article **Deep Learning CUDA Memory Usage and Pytorch optimization tricks**☆43Updated 5 years ago
- [ICML 2022] "Coarsening the Granularity: Towards Structurally Sparse Lottery Tickets" by Tianlong Chen, Xuxi Chen, Xiaolong Ma, Yanzhi Wa…☆33Updated 2 years ago
- Code for "Supermasks in Superposition"☆124Updated last year
- ☆19Updated 3 years ago
- Presents comprehensive benchmarks of XLA-compatible pre-trained models in Keras.☆37Updated 2 years ago
- ☆19Updated 3 years ago
- Context Manager to profile the forward and backward times of PyTorch's nn.Module☆83Updated last year
- Bibtex for Sparsity in Deep Learning paper (https://arxiv.org/abs/2102.00554) - open for pull requests☆46Updated 3 years ago
- Identify a binary weight or binary weight and activation subnetwork within a randomly initialized network by only pruning and binarizing …☆52Updated 3 years ago
- [NeurIPS 2022] DataMUX: Data Multiplexing for Neural Networks☆60Updated 2 years ago
- ☆213Updated 2 years ago
- ☆14Updated 3 years ago
- Butterfly matrix multiplication in PyTorch☆174Updated last year
- Minimal implementation of adaptive gradient clipping (https://arxiv.org/abs/2102.06171) in TensorFlow 2.☆85Updated 4 years ago
- Experiment of using Tangent to autodiff triton☆80Updated last year
- [ICLR 2020] Drawing Early-Bird Tickets: Toward More Efficient Training of Deep Networks☆138Updated 4 years ago
- Examples of using PyTorch hooks, as covered in my YouTube tutorial video.☆37Updated last year
- [JMLR'20] NeurIPS 2019 MicroNet Challenge Efficient Language Modeling, Champion☆40Updated 4 years ago
- Latest Weight Averaging (NeurIPS HITY 2022)☆31Updated 2 years ago
- Implements MLP-Mixer (https://arxiv.org/abs/2105.01601) with the CIFAR-10 dataset.☆57Updated 3 years ago
- Factorized Neural Layers☆29Updated 2 years ago
- DropNet: Reducing Neural Network Complexity via Iterative Pruning (ICML 2020)☆17Updated 5 years ago
- Revisiting Efficient Training Algorithms For Transformer-based Language Models (NeurIPS 2023)☆81Updated 2 years ago