Alternatives and similar repositories for TextNAS

Users that are interested in TextNAS are comparing it to the libraries listed below

• huggingface / block_movement_pruning
  Block Sparse movement pruning
  ☆83Updated 5 years ago
• mit-han-lab / hardware-aware-transformers
  [ACL'20] HAT: Hardware-Aware Transformers for Efficient Natural Language Processing
  ☆337Updated last year
• huggingface / nn_pruning
  Prune a model while finetuning or training.
  ☆406Updated 3 years ago
• yandex-research / DeDLOC
  Official code for "Distributed Deep Learning in Open Collaborations" (NeurIPS 2021)
  ☆117Updated 4 years ago
• asappresearch / flop
  Pytorch library for factorized L0-based pruning.
  ☆45Updated 2 years ago
• hpcaitech / PaLM-colossalai
  Scalable PaLM implementation of PyTorch
  ☆190Updated 3 years ago
• HazyResearch / fly
  ☆222Updated 2 years ago
• graphcore / tutorials
  Training material for IPU users: tutorials, feature examples, simple applications
  ☆88Updated 2 years ago
• clovaai / length-adaptive-transformer
  Official Pytorch Implementation of Length-Adaptive Transformer (ACL 2021)
  ☆102Updated 5 years ago
• microsoft / Stochastic-Mixture-of-Experts
  This package implements THOR: Transformer with Stochastic Experts.
  ☆65Updated 4 years ago
• yaozhewei / MLPruning
  MLPruning, PyTorch, NLP, BERT, Structured Pruning
  ☆20Updated 4 years ago
• princeton-nlp / DataMUX
  [NeurIPS 2022] DataMUX: Data Multiplexing for Neural Networks
  ☆60Updated 3 years ago
• princeton-nlp / CoFiPruning
  [ACL 2022] Structured Pruning Learns Compact and Accurate Models https://arxiv.org/abs/2204.00408
  ☆198Updated 2 years ago
• castorini / DeeBERT
  DeeBERT: Dynamic Early Exiting for Accelerating BERT Inference
  ☆162Updated 3 years ago
• IBM / PoWER-BERT
  Method to improve inference time for BERT. This is an implementation of the paper titled "PoWER-BERT: Accelerating BERT Inference via Pro…
  ☆62Updated 4 months ago
• quentinf00 / article-memory-log
  Implémentation of the article **Deep Learning CUDA Memory Usage and Pytorch optimization tricks**
  ☆43Updated 6 years ago
• huggingface / transformers_bloom_parallel
  Techniques used to run BLOOM at inference in parallel
  ☆37Updated 3 years ago
• kssteven418 / BigLittleDecoder
  [NeurIPS'23] Speculative Decoding with Big Little Decoder
  ☆96Updated 2 years ago
• lucidrains / PaLM-jax
  Implementation of the specific Transformer architecture from PaLM - Scaling Language Modeling with Pathways - in Jax (Equinox framework)
  ☆190Updated 3 years ago
• WoosukKwon / retraining-free-pruning
  [NeurIPS 2022] A Fast Post-Training Pruning Framework for Transformers
  ☆192Updated 2 years ago
• amazon-science / dq-bart
  DQ-BART: Efficient Sequence-to-Sequence Model via Joint Distillation and Quantization (ACL 2022)
  ☆50Updated 2 years ago
• spcl / substation
  Research and development for optimizing transformers
  ☆131Updated 4 years ago
• nod-ai / transformer-benchmarks
  benchmarking some transformer deployments
  ☆26Updated last month
• kssteven418 / LTP
  [KDD'22] Learned Token Pruning for Transformers
  ☆102Updated 2 years ago
• automl / awesome-transformer-search
  A curated list of awesome resources combining Transformers with Neural Architecture Search
  ☆271Updated 2 years ago
• AI21Labs / lm-evaluation
  Evaluation suite for large-scale language models.
  ☆129Updated 4 years ago
• huggingface / bloom-jax-inference
  ☆66Updated 3 years ago
• microsoft / BANG
  BANG is a new pretraining model to Bridge the gap between Autoregressive (AR) and Non-autoregressive (NAR) Generation. AR and NAR generat…
  ☆28Updated 4 years ago
• VITA-Group / BERT-Tickets
  [NeurIPS 2020] "The Lottery Ticket Hypothesis for Pre-trained BERT Networks", Tianlong Chen, Jonathan Frankle, Shiyu Chang, Sijia Liu, Ya…
  ☆142Updated 4 years ago
• microsoft / varuna
  ☆252Updated last year