twinkle0331 / XcompressionLinks
[ICLR 2022] Code for paper "Exploring Extreme Parameter Compression for Pre-trained Language Models"(https://arxiv.org/abs/2205.10036)
☆22Updated 2 years ago
Alternatives and similar repositories for Xcompression
Users that are interested in Xcompression are comparing it to the libraries listed below
Sorting:
- [KDD'22] Learned Token Pruning for Transformers☆100Updated 2 years ago
- ☆14Updated 2 years ago
- This package implements THOR: Transformer with Stochastic Experts.☆65Updated 3 years ago
- Pytorch library for factorized L0-based pruning.☆45Updated last year
- [ACL 2022] Structured Pruning Learns Compact and Accurate Models https://arxiv.org/abs/2204.00408☆197Updated 2 years ago
- This PyTorch package implements MoEBERT: from BERT to Mixture-of-Experts via Importance-Guided Adaptation (NAACL 2022).☆112Updated 3 years ago
- ☆21Updated 2 years ago
- This pytorch package implements PLATON: Pruning Large Transformer Models with Upper Confidence Bound of Weight Importance (ICML 2022).