sseung0703 / Lightweighting_CookbookLinks
This project attempts to build neural network training and lightweighting cookbook including three kinds of lightweighting solutions, i.e., knowledge distillation, filter pruning, and quantization.
☆22Updated 2 years ago
Alternatives and similar repositories for Lightweighting_Cookbook
Users that are interested in Lightweighting_Cookbook are comparing it to the libraries listed below
Sorting:
- Learning Features with Parameter-Free Layers, ICLR 2022☆84Updated 2 years ago
- Tensorflow2 training code with jit compiling on multi-GPU.☆17Updated 4 years ago
- Automatic Mixed Precision Tutorials using pytorch. Based on PyTorch 1.6 Official Features, implement classification codebase using custo…☆89Updated 4 years ago
- Official repository for Automated Learning Rate Scheduler for Large-Batch Training (8th ICML Workshop on AutoML)☆40Updated 3 years ago
- Reproduction of Vision Transformer in Tensorflow2. Train from scratch and Finetune.☆48Updated 3 years ago
- A minimal implementation of Gaussian process regression in PyTorch☆62Updated 2 years ago
- (ICML 2022) Official PyTorch implementation of “Blurs Behave Like Ensembles: Spatial Smoothings to Improve Accuracy, Uncertainty, and Rob…☆78Updated 2 years ago
- ☆25Updated 4 months ago
- A PyTorch Implementation of the Luna: Linear Unified Nested Attention☆41Updated 3 years ago
- ☆88Updated last year
- mo papers mo problems☆20Updated 5 years ago
- Jax/Flax implementation of DeiT and DeiT-III (ViT)☆18Updated 5 months ago
- Information and Materials for the Deep Learning Course☆31Updated 2 years ago
- A clean and structured implementation of Transformer with wandb and pytorch-lightning☆70Updated 2 years ago
- A performance library for machine learning applications.☆183Updated last year
- my useful torch lightning training template☆32Updated 2 years ago
- [ICLR 2023] RC-MAE☆52Updated last year
- read 1 paper everyday (only weekday)☆56Updated 3 years ago
- Official Pytorch Implementation of Unsupervised Representation Learning for Binary Networks by Joint Classifier Training (CVPR 2022)☆10Updated 3 years ago
- Simple implementation of muP, based on Spectral Condition for Feature Learning. The implementation is SGD only, dont use it for Adam☆77Updated 10 months ago
- The official repository for <Autoencoding Under Normalization Constraints> (Yoon, Noh and Park, ICML 2021).☆43Updated last year
- Paper Today I Read☆26Updated 5 months ago
- Yet Another Reinforcement Learning Tutorial☆73Updated 2 years ago
- 거꾸로 읽는 self-supervised learning in NLP☆27Updated 2 years ago
- Tensorflow Implementation of "Slowing Down the Weight Norm Increase in Momentum-based Optimizers"☆47Updated 4 years ago
- ☆186Updated 3 years ago
- ☆47Updated last year
- TensorFlow 1.x Practice☆15Updated 4 years ago
- annotated-transformer-kr☆15Updated 6 years ago
- Ensemble Knowledge Guided Sub-network Search and Fine-tuning for Filter Pruning☆18Updated 2 years ago