This project attempts to build neural network training and lightweighting cookbook including three kinds of lightweighting solutions, i.e., knowledge distillation, filter pruning, and quantization.
☆22Jul 20, 2022Updated 4 years ago
Alternatives and similar repositories for Lightweighting_Cookbook
Users that are interested in Lightweighting_Cookbook are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Ensemble Knowledge Guided Sub-network Search and Fine-tuning for Filter Pruning☆19Sep 20, 2022Updated 4 years ago
- pytorch implementation of "A Theoretically Grounded Application of Dropout in Recurrent Neural Networks" LSTM(https://arxiv.org/abs/1512.…☆22Nov 20, 2020Updated 5 years ago
- ☆51Aug 8, 2019Updated 7 years ago
- ☆14Dec 16, 2020Updated 5 years ago
- Zero-Shot Knowledge Distillation in Deep Networks in ICML2019☆48Jun 20, 2019Updated 7 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Synthesized Rain dataset☆28Oct 11, 2023Updated 3 years ago
- Knowledge distillation methods implemented with Tensorflow (now there are 11 (+1) methods, and will be added more.)☆264Nov 21, 2019Updated 6 years ago
- Audio Signal Processing & Speech Recognition☆26Jan 24, 2021Updated 5 years ago
- ☆15Sep 29, 2022Updated 4 years ago
- ☆55Nov 22, 2022Updated 3 years ago
- Google Colab tutorial with simple network training and Tensorboard.☆14Jul 17, 2019Updated 7 years ago
- JAX notebook showing how to LoRA + GPTQ arbitrary models☆10Aug 8, 2023Updated 3 years ago
- The goal of this project is to develop a program for planetary soft landings using lossless convexification of non convex control bounds.☆11Mar 25, 2022Updated 4 years ago
- ☆20Mar 25, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- collect pictures☆18Jul 26, 2022Updated 4 years ago
- ☆13Nov 14, 2024Updated 2 years ago
- Baseline implementations on the MuMiN dataset☆10Oct 18, 2023Updated 3 years ago
- T5 model optimized with FlexAttention☆14Sep 30, 2024Updated 2 years ago
- Source code for the paper "FedUKD: Federated UNet Model with Knowledge Distillation for Land Use Classification from Satellite and Street…☆12Mar 8, 2022Updated 4 years ago
- Reproducing VID in CVPR2019 (on working)☆20Nov 25, 2019Updated 6 years ago
- Winning 3rd Place solution for HubMap - Hacking the Human Vasculature hosted on Kaggle☆17Aug 10, 2023Updated 3 years ago
- Lightning-like training API for JAX with Flax☆45Dec 8, 2024Updated last year
- [EMNLP2024] Rethinking Token Reduction for State Space Models☆11Dec 7, 2024Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆11Jun 4, 2021Updated 5 years ago
- ☆17Mar 27, 2018Updated 8 years ago
- Source code for the paper "FedUKD: Federated UNet Model with Knowledge Distillation for Land Use Classification from Satellite and Street…☆19Feb 9, 2023Updated 3 years ago
- An implementation of DreamerV2 written in JAX, with support for running multiple random seeds of an experiment on a single GPU.☆18Jan 16, 2023Updated 3 years ago
- Scaling to Tens of Thousands of Test-Time Iterations with Loop-Native Attention Residuals☆15Oct 21, 2026Updated 3 weeks ago
- [ECCV 2026] Implementation of "CUST : Clustered Unit-level Similarity Transformer for Lightweight Image Super-Resolution"☆12Aug 7, 2026Updated 3 months ago
- Megatron-LM setup in the smol-cluster☆12Aug 26, 2024Updated 2 years ago
- Pile Deduplication Code☆18May 15, 2023Updated 3 years ago
- All the useful tools I have been using while working in data science for remote sensing☆11Nov 27, 2019Updated 6 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆13Jul 4, 2020Updated 6 years ago
- ☆12Apr 5, 2017Updated 9 years ago
- EmotiW 2018☆20Dec 25, 2018Updated 7 years ago
- Jax, Flax, examples (ImageClassification, SemanticSegmentation, and more...)☆10May 10, 2025Updated last year
- This repository contains the code for my home improvements projects (home automation, plants watering, everyday calendar, motorized mobil…☆10Dec 9, 2022Updated 3 years ago
- Python scripts to facilitate easy working☆11Mar 23, 2026Updated 7 months ago
- EntroPIC: Towards Stable Long-Term Training of LLMs via Entropy Stabilization with Proportional-Integral Control☆13Feb 3, 2026Updated 9 months ago
Are these results useful?