sseung0703 / Lightweighting_Cookbook
This project attempts to build neural network training and lightweighting cookbook including three kinds of lightweighting solutions, i.e., knowledge distillation, filter pruning, and quantization.
☆22Updated 2 years ago
Alternatives and similar repositories for Lightweighting_Cookbook:
Users that are interested in Lightweighting_Cookbook are comparing it to the libraries listed below
- Tensorflow2 training code with jit compiling on multi-GPU.☆17Updated 4 years ago
- Learning Features with Parameter-Free Layers, ICLR 2022☆85Updated last year
- Official repository for Automated Learning Rate Scheduler for Large-Batch Training (8th ICML Workshop on AutoML)☆40Updated 3 years ago
- Reproduction of Vision Transformer in Tensorflow2. Train from scratch and Finetune.☆48Updated 3 years ago
- 이화여대 강의자료☆28Updated last year
- Automatic Mixed Precision Tutorials using pytorch. Based on PyTorch 1.6 Official Features, implement classification codebase using custo…☆88Updated 4 years ago
- Serving Example of CodeGen-350M-Mono-GPTJ on Triton Inference Server with Docker and Kubernetes☆20Updated last year
- my useful torch lightning training template☆32Updated last year
- Information and Materials for the Deep Learning Course☆30Updated 2 years ago
- ☆185Updated 2 years ago
- Making a PyTorch model easier than ever!☆78Updated 3 years ago
- Tensorflow Implementation of "Slowing Down the Weight Norm Increase in Momentum-based Optimizers"☆46Updated 3 years ago
- A clean and structured implementation of Transformer with wandb and pytorch-lightning☆71Updated 2 years ago
- Simple implementation of muP, based on Spectral Condition for Feature Learning. The implementation is SGD only, dont use it for Adam☆73Updated 6 months ago
- Yet Another Reinforcement Learning Tutorial☆72Updated last year
- A minimal implementation of Gaussian process regression in PyTorch☆61Updated 2 years ago
- KAIST AI605 Deep Learning for NLP☆31Updated 2 years ago
- [Google Meet] MLLM Arxiv Casual Talk☆53Updated last year
- The OTHER pytorch boilerplate☆43Updated 3 years ago
- Getting GPU Util 99%☆33Updated 4 years ago
- A collection of various deep learning architectures, models, and tips☆63Updated 4 years ago
- Implementation of RQ Transformer, proposed in the paper "Autoregressive Image Generation using Residual Quantization"☆99Updated 2 years ago
- ☆56Updated 2 years ago
- Python Project Template☆67Updated 2 years ago
- Simple llama usage example☆48Updated last year
- Simple project base template for PyTorch deep Learning project. Features clean implementation of DDP training and Hydra config.☆57Updated 2 months ago
- [ICLR 2023] RC-MAE☆51Updated last year
- read 1 paper everyday (only weekday)☆56Updated 3 years ago
- Brain Agent for Large-Scale and Multi-Task Agent Learning☆94Updated last year
- Jax/Flax implementation of DeiT and DeiT-III (ViT)☆16Updated last month