sseung0703 / Lightweighting_Cookbook
This project attempts to build neural network training and lightweighting cookbook including three kinds of lightweighting solutions, i.e., knowledge distillation, filter pruning, and quantization.
☆23Updated 2 years ago
Related projects: ⓘ
- Tensorflow2 training code with jit compiling on multi-GPU.☆17Updated 3 years ago
- Official repository for Automated Learning Rate Scheduler for Large-Batch Training (8th ICML Workshop on AutoML)☆39Updated 2 years ago
- Learning Features with Parameter-Free Layers, ICLR 2022☆85Updated last year
- Reproduction of Vision Transformer in Tensorflow2. Train from scratch and Finetune.☆47Updated 2 years ago
- Simple implementation of muP, based on Spectral Condition for Feature Learning. The implementation is SGD only, dont use it for Adam☆66Updated last month
- Automatic Mixed Precision Tutorials using pytorch. Based on PyTorch 1.6 Official Features, implement classification codebase using custo…☆89Updated 4 years ago
- Serving Example of CodeGen-350M-Mono-GPTJ on Triton Inference Server with Docker and Kubernetes☆20Updated last year
- A minimal implementation of Gaussian process regression in PyTorch☆59Updated last year
- [ICLR 2023] RC-MAE☆51Updated 9 months ago
- Information and Materials for the Deep Learning Course☆31Updated 2 years ago
- my useful torch lightning training template☆33Updated last year
- These papers will provide unique insightful concepts that will broaden your perspective on neural networks and deep learning☆44Updated last year
- Implementation of RQ Transformer, proposed in the paper "Autoregressive Image Generation using Residual Quantization"☆74Updated 2 years ago
- read 1 paper everyday (only weekday)☆53Updated 2 years ago
- The OTHER pytorch boilerplate☆43Updated 3 years ago
- (ICML 2022) Official PyTorch implementation of “Blurs Behave Like Ensembles: Spatial Smoothings to Improve Accuracy, Uncertainty, and Rob…☆76Updated 2 years ago
- ☆10Updated last year
- 이화여대 강의자료☆25Updated 7 months ago
- Official Pytorch Implementation of Unsupervised Representation Learning for Binary Networks by Joint Classifier Training (CVPR 2022)☆10Updated 2 years ago
- Jax/Flax implementation of DeiT and DeiT-III (ViT)☆13Updated 5 months ago
- ☆77Updated 5 months ago
- A performance library for machine learning applications.☆178Updated 11 months ago
- Tensorflow Implementation of "Slowing Down the Weight Norm Increase in Momentum-based Optimizers"☆46Updated 3 years ago
- A clean and structured implementation of Transformer with wandb and pytorch-lightning☆71Updated last year
- The official repository for <Autoencoding Under Normalization Constraints> (Yoon, Noh and Park, ICML 2021).☆42Updated last year
- ☆128Updated last year
- A PyTorch Implementation of the Luna: Linear Unified Nested Attention☆39Updated 3 years ago
- Official Pytorch implementation of C3-GAN (Spotlight at ICLR 2022)☆125Updated 2 years ago
- Course Website for "AI618: Generative Model and Unsupervised Learning"☆35Updated last year