hikvision-research / Unified-NormalizationLinks
# Unified Normalization (ACM MM'22) By Qiming Yang, Kai Zhang, Chaoxiang Lan, Zhi Yang, Zheyang Li, Wenming Tan, Jun Xiao, and Shiliang Pu. This repository is the official implementation of "Unified Normalization for Accelerating and Stabilizing Transformers"
☆34Updated 2 years ago
Alternatives and similar repositories for Unified-Normalization
Users that are interested in Unified-Normalization are comparing it to the libraries listed below
Sorting:
- PyTorch code and checkpoints release for VanillaKD: https://arxiv.org/abs/2305.15781☆76Updated 2 years ago
- ☆13Updated 2 years ago
- Training LLaMA language model with MMEngine! It supports LoRA fine-tuning!☆41Updated 2 years ago
- An object detection codebase based on MegEngine.☆28Updated 3 years ago
- ☆23Updated 3 years ago
- Slides with modifications for a course at Tsinghua University.☆62Updated 3 years ago
- MegEngine到其他框架的转换器☆69Updated 2 years ago
- A codebase & model zoo for pretrained backbone based on MegEngine.☆33Updated 2 years ago
- [TMLR] Official PyTorch implementation of paper "Efficient Quantization-aware Training with Adaptive Coreset Selection"☆35Updated last year
- ☆17Updated 3 years ago
- [ICML 2022] "DepthShrinker: A New Compression Paradigm Towards Boosting Real-Hardware Efficiency of Compact Neural Networks", by Yonggan …☆72Updated 3 years ago
- PyTorch implementation of SSQL (Accepted to ECCV2022 oral presentation)☆73Updated 2 years ago
- IntLLaMA: A fast and light quantization solution for LLaMA☆18Updated 2 years ago
- ☆23Updated last year
- Page for the CVPR 2023 Tutorial - Efficient Neural Networks: From Algorithm Design to Practical Mobile Deployments☆12Updated 2 years ago
- [NeurIPS 2022 Spotlight] This is the official PyTorch implementation of "EcoFormer: Energy-Saving Attention with Linear Complexity"☆74Updated 3 years ago
- [ICLR 2024] This is the official PyTorch implementation of "QLLM: Accurate and Efficient Low-Bitwidth Quantization for Large Language Mod…☆39Updated last year
- ☆36Updated 2 years ago
- ☆61Updated last year
- PyTorch Quantization Aware Training Example☆146Updated last year
- Code for RepNAS☆14Updated 4 years ago
- An implementation of <Group Fisher Pruning for Practical Network Compression> based on pytorch and mmcv☆18Updated 4 years ago
- [ICLR 2022] "As-ViT: Auto-scaling Vision Transformers without Training" by Wuyang Chen, Wei Huang, Xianzhi Du, Xiaodan Song, Zhangyang Wa…☆76Updated 3 years ago
- [ECCV 2024] Isomorphic Pruning for Vision Models☆77Updated last year
- The official implementation of the paper "Reducing Fine-Tuning Memory Overhead by Approximate and Memory-Sharing Backpropagation"☆21Updated last year
- [ICLR 2024] This is the official PyTorch implementation of "QLLM: Accurate and Efficient Low-Bitwidth Quantization for Large Language Mod…☆30Updated last year
- ☆40Updated 2 years ago
- [ICML 2022] "DepthShrinker: A New Compression Paradigm Towards Boosting Real-Hardware Efficiency of Compact Neural Networks", by Yonggan …☆35Updated 3 years ago
- TVMScript kernel for deformable attention☆25Updated 4 years ago
- Collections of model quantization algorithms. Any issues, please contact Peng Chen (blueardour@gmail.com)☆73Updated 4 years ago