hikvision-research / Unified-NormalizationLinks
# Unified Normalization (ACM MM'22) By Qiming Yang, Kai Zhang, Chaoxiang Lan, Zhi Yang, Zheyang Li, Wenming Tan, Jun Xiao, and Shiliang Pu. This repository is the official implementation of "Unified Normalization for Accelerating and Stabilizing Transformers"
☆34Updated 2 years ago
Alternatives and similar repositories for Unified-Normalization
Users that are interested in Unified-Normalization are comparing it to the libraries listed below
Sorting:
- PyTorch code and checkpoints release for VanillaKD: https://arxiv.org/abs/2305.15781☆76Updated last year
- An object detection codebase based on MegEngine.☆28Updated 2 years ago
- ☆13Updated 2 years ago
- A codebase & model zoo for pretrained backbone based on MegEngine.☆33Updated 2 years ago
- Training LLaMA language model with MMEngine! It supports LoRA fine-tuning!☆41Updated 2 years ago
- PyTorch implementation of SSQL (Accepted to ECCV2022 oral presentation)☆73Updated 2 years ago
- [ICML 2022] "DepthShrinker: A New Compression Paradigm Towards Boosting Real-Hardware Efficiency of Compact Neural Networks", by Yonggan …☆72Updated 3 years ago
- MegEngine到其他框架的转换器☆70Updated 2 years ago
- ☆23Updated 11 months ago
- [ECCV 2024] Isomorphic Pruning for Vision Models☆79Updated last year
- useful dotfiles included vim, zsh, tmux and vscode☆18Updated last month
- IntLLaMA: A fast and light quantization solution for LLaMA☆18Updated 2 years ago
- Slides with modifications for a course at Tsinghua University.☆62Updated 3 years ago
- Official PyTorch implementation of "LayerMerge: Neural Network Depth Compression through Layer Pruning and Merging" (ICML 2024)☆30Updated last year
- [ICLR 2022] "As-ViT: Auto-scaling Vision Transformers without Training" by Wuyang Chen, Wei Huang, Xianzhi Du, Xiaodan Song, Zhangyang Wa…☆76Updated 3 years ago
- Official Pytorch implementation of Super Vision Transformer (IJCV)☆43Updated 2 years ago
- An implementation of <Group Fisher Pruning for Practical Network Compression> based on pytorch and mmcv☆18Updated 3 years ago
- TVMScript kernel for deformable attention☆25Updated 3 years ago
- Zero-label image classification via OpenCLIP knowledge distillation☆136Updated 2 years ago
- ☆36Updated 2 years ago
- Code for RepNAS☆13Updated 3 years ago
- PyTorch Quantization Aware Training Example☆140Updated last year
- [ICML 2022] "DepthShrinker: A New Compression Paradigm Towards Boosting Real-Hardware Efficiency of Compact Neural Networks", by Yonggan …☆35Updated 3 years ago
- ☆61Updated last year
- NVIDIA TensorRT Hackathon 2023复赛选题:通义千问Qwen-7B用TensorRT-LLM模型搭建及优化☆42Updated last year
- Pytorch implementation of RAPQ, IJCAI 2022☆22Updated 2 years ago
- Official implementation of paper "Masked Distillation with Receptive Tokens", ICLR 2023.☆71Updated 2 years ago
- ☆17Updated 3 years ago
- [TMLR] Official PyTorch implementation of paper "Efficient Quantization-aware Training with Adaptive Coreset Selection"☆34Updated last year
- Batch Normalization Auto-fusion for PyTorch☆32Updated 5 years ago