landskape-ai / Progressive-Pruning
Official pytorch code for "APP: Anytime Progressive Pruning" (DyNN @ ICML, 2022; CLL @ ACML, 2022, SNN @ ICML, 2022 and SlowDNN 2023)
☆16Updated 2 years ago
Alternatives and similar repositories for Progressive-Pruning:
Users that are interested in Progressive-Pruning are comparing it to the libraries listed below
- Context Manager to profile the forward and backward times of PyTorch's nn.Module☆84Updated last year
- This repository hosts the code to port NumPy model weights of BiT-ResNets to TensorFlow SavedModel format.☆14Updated 3 years ago
- Shows how to do parameter ensembling using differential evolution.☆10Updated 3 years ago
- ☆24Updated 2 years ago
- Contains my experiments with the `big_vision` repo to train ViTs on ImageNet-1k.☆22Updated 2 years ago
- ☆19Updated 3 years ago
- Efficient Deep Learning Survey Paper☆33Updated 2 years ago
- Neural Arithmetic Logic Units by Trask et al.☆12Updated 5 years ago
- PyTorch implementation of GLOM☆21Updated 2 years ago
- [ECCV 2022] SuperTickets: Drawing Task-Agnostic Lottery Tickets from Supernets via Jointly Architecture Searching and Parameter Pruning☆19Updated 2 years ago
- Little article showing how to load pytorch's models with linear memory consumption☆34Updated 2 years ago
- An open source implementation of CLIP.☆32Updated 2 years ago
- Experiments with the ideas presented in https://arxiv.org/abs/2003.00152 by Frankle et al.☆29Updated 4 years ago
- Minimal implementation of Denoised Smoothing (https://arxiv.org/abs/2003.01908) in TensorFlow.☆20Updated 3 years ago
- DropNet: Reducing Neural Network Complexity via Iterative Pruning (ICML 2020)☆15Updated 4 years ago
- Implements MLP-Mixer (https://arxiv.org/abs/2105.01601) with the CIFAR-10 dataset.☆56Updated 2 years ago
- Explores the ideas presented in Deep Ensembles: A Loss Landscape Perspective (https://arxiv.org/abs/1912.02757) by Stanislav Fort, Huiyi …☆63Updated 4 years ago
- Implementation of modern data augmentation techniques in TensorFlow 2.x to be used in your training pipeline.☆34Updated 4 years ago
- ☆10Updated 3 years ago
- ☆36Updated 3 years ago
- Examples of using PyTorch hooks, as covered in my YouTube tutorial video.☆33Updated last year
- A case study of efficient training of large language models using commodity hardware.☆68Updated 2 years ago
- Transformer block in tf.keras similar to PyTorch's nn.Transformer block.☆9Updated 4 years ago
- [ICML 2022] "Coarsening the Granularity: Towards Structurally Sparse Lottery Tickets" by Tianlong Chen, Xuxi Chen, Xiaolong Ma, Yanzhi Wa…☆32Updated last year
- A GPT, made only of MLPs, in Jax☆57Updated 3 years ago
- Fastai community entry to 2020 Reproducibility Challenge☆18Updated 2 years ago
- Official PyTorch implementation of LilNetX: Lightweight Networks with EXtreme Model Compression and Structured Sparsification☆46Updated 2 years ago
- A simple Transformer where the softmax has been replaced with normalization☆19Updated 4 years ago
- ☆13Updated 3 years ago
- ☆47Updated 2 years ago