microsoft / TextNASLinks
This is the implementation of the TextNAS algorithm proposed in the paper TextNAS: A Neural Architecture Search Space tailored for Text Representation.
☆15Updated 2 years ago
Alternatives and similar repositories for TextNAS
Users that are interested in TextNAS are comparing it to the libraries listed below
Sorting:
- Block Sparse movement pruning☆81Updated 4 years ago
- [ACL'20] HAT: Hardware-Aware Transformers for Efficient Natural Language Processing☆335Updated last year
- [NeurIPS 2022] DataMUX: Data Multiplexing for Neural Networks☆60Updated 2 years ago
- Official code for "Distributed Deep Learning in Open Collaborations" (NeurIPS 2021)☆117Updated 3 years ago
- Training material for IPU users: tutorials, feature examples, simple applications☆87Updated 2 years ago
- ☆17Updated 5 years ago
- Renee: End-to-end training of extreme classification models☆23Updated 2 years ago
- Flexible simulator for mixed precision and format simulation of LLMs and vision transformers.☆51Updated 2 years ago
- [NeurIPS 2020] "The Lottery Ticket Hypothesis for Pre-trained BERT Networks", Tianlong Chen, Jonathan Frankle, Shiyu Chang, Sijia Liu, Ya…☆141Updated 3 years ago
- Official Pytorch Implementation of Length-Adaptive Transformer (ACL 2021)☆102Updated 4 years ago
- Method to improve inference time for BERT. This is an implementation of the paper titled "PoWER-BERT: Accelerating BERT Inference via Pro…☆62Updated last month
- Scalable PaLM implementation of PyTorch☆188Updated 2 years ago
- benchmarking some transformer deployments☆26Updated 2 years ago
- Research and development for optimizing transformers☆131Updated 4 years ago
- ☆218Updated 2 years ago
- ☆23Updated 4 years ago
- [NeurIPS'23] Speculative Decoding with Big Little Decoder☆94Updated last year
- DeeBERT: Dynamic Early Exiting for Accelerating BERT Inference☆160Updated 3 years ago
- [JMLR'20] NeurIPS 2019 MicroNet Challenge Efficient Language Modeling, Champion☆40Updated 4 years ago
- BANG is a new pretraining model to Bridge the gap between Autoregressive (AR) and Non-autoregressive (NAR) Generation. AR and NAR generat…☆28Updated 3 years ago
- ☆15Updated 4 years ago
- ☆252Updated last year
- This package implements THOR: Transformer with Stochastic Experts.☆65Updated 4 years ago
- A curated list of Early Exiting papers, benchmarks, and misc.☆117Updated last year
- Pytorch library for factorized L0-based pruning.☆45Updated 2 years ago
- Evaluation suite for large-scale language models.☆128Updated 4 years ago
- Repository for the QUIK project, enabling the use of 4bit kernels for generative inference - EMNLP 2024☆183Updated last year
- ☆18Updated last year
- AutoMoE: Neural Architecture Search for Efficient Sparsely Activated Transformers☆47Updated 2 years ago
- [NeurIPS 2022] A Fast Post-Training Pruning Framework for Transformers☆192Updated 2 years ago