sseung0703 / Lightweighting_CookbookLinks
This project attempts to build neural network training and lightweighting cookbook including three kinds of lightweighting solutions, i.e., knowledge distillation, filter pruning, and quantization.
☆22Updated 3 years ago
Alternatives and similar repositories for Lightweighting_Cookbook
Users that are interested in Lightweighting_Cookbook are comparing it to the libraries listed below
Sorting:
- Learning Features with Parameter-Free Layers, ICLR 2022☆84Updated 2 years ago
- A minimal implementation of Gaussian process regression in PyTorch☆65Updated 3 years ago
- Jax/Flax implementation of DeiT and DeiT-III (ViT)☆19Updated last year
- Automatic Mixed Precision Tutorials using pytorch. Based on PyTorch 1.6 Official Features, implement classification codebase using custo…☆90Updated 5 years ago
- Reproduction of Vision Transformer in Tensorflow2. Train from scratch and Finetune.☆48Updated 4 years ago
- The OTHER pytorch boilerplate☆45Updated 9 months ago
- Official repository for Automated Learning Rate Scheduler for Large-Batch Training (8th ICML Workshop on AutoML)☆40Updated 4 years ago
- Tensorflow2 training code with jit compiling on multi-GPU.☆17Updated 4 years ago
- A performance library for machine learning applications.☆184Updated 2 years ago
- ☆29Updated last year
- PyTorch Model Compression☆234Updated 2 years ago
- AdamP: Slowing Down the Slowdown for Momentum Optimizers on Scale-invariant Weights (ICLR 2021)☆412Updated 5 years ago
- ☆75Updated 3 years ago
- OSLO: Open Source framework for Large-scale model Optimization☆309Updated 3 years ago
- read 1 paper everyday (only weekday)☆55Updated 4 years ago
- Official Pytorch implementation of C3-GAN (Spotlight at ICLR 2022)☆128Updated 3 years ago
- Implementation of Mega, the Single-head Attention with Multi-headed EMA architecture that currently holds SOTA on Long Range Arena☆206Updated 2 years ago
- Making a PyTorch model easier than ever!☆80Updated 4 years ago
- OSLO: Open Source for Large-scale Optimization☆175Updated 2 years ago
- (ICML 2022) Official PyTorch implementation of “Blurs Behave Like Ensembles: Spatial Smoothings to Improve Accuracy, Uncertainty, and Rob…☆79Updated 3 years ago
- Tensorflow Implementation of "Slowing Down the Weight Norm Increase in Momentum-based Optimizers"☆47Updated 4 years ago
- ☆90Updated last year
- Simple implementation of muP, based on Spectral Condition for Feature Learning. The implementation is SGD only, dont use it for Adam☆85Updated last year
- ☆56Updated last year
- Official PyTorch implementation of the paper: "Solving ImageNet: a Unified Scheme for Training any Backbone to Top Results" (2022)☆193Updated 3 years ago
- Implementation of fused cosine similarity attention in the same style as Flash Attention☆219Updated 2 years ago
- Implementation of Fast Transformer in Pytorch☆177Updated 4 years ago
- Unofficial JAX implementations of deep learning research papers☆160Updated 3 years ago
- TF/Keras code for DiffStride, a pooling layer with learnable strides.☆124Updated 3 years ago
- Official PyTorch implementation of "Rapid Neural Architecture Search by Learning to Generate Graphs from Datasets" (ICLR 2021)☆64Updated last year