Alternatives and similar repositories for Efficient-NLP:

Users that are interested in Efficient-NLP are comparing it to the libraries listed below

• benzakenelad / BitFit
  Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models
  ☆140Updated 2 years ago
• thunlp / MoEfication
  ☆125Updated 8 months ago
• john-hewitt / backpacks-flash-attn
  The original Backpack Language Model implementation, a fork of FlashAttention
  ☆66Updated last year
• SimiaoZuo / MoEBERT
  This PyTorch package implements MoEBERT: from BERT to Mixture-of-Experts via Importance-Guided Adaptation (NAACL 2022).
  ☆103Updated 2 years ago
• princeton-nlp / CoFiPruning
  [ACL 2022] Structured Pruning Learns Compact and Accurate Models https://arxiv.org/abs/2204.00408
  ☆196Updated last year
• VITA-Group / Random-MoE-as-Dropout
  [ICLR 2023] "Sparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformers" by Tianlong Chen*, Zhenyu Zhang*, Ajay Jaiswal…
  ☆48Updated 2 years ago
• QingruZhang / PLATON
  This pytorch package implements PLATON: Pruning Large Transformer Models with Upper Confidence Bound of Weight Importance (ICML 2022).
  ☆43Updated 2 years ago
• cambridgeltl / autopeft
  AutoPEFT: Automatic Configuration Search for Parameter-Efficient Fine-Tuning (Zhou et al.; TACL 2024)
  ☆46Updated last year
• bloomberg / dataless-model-merging
  Code release for Dataless Knowledge Fusion by Merging Weights of Language Models (https://openreview.net/forum?id=FCnohuR6AnM)
  ☆87Updated last year
• rabeehk / compacter
  ☆127Updated 2 years ago
• amazon-science / dq-bart
  DQ-BART: Efficient Sequence-to-Sequence Model via Joint Distillation and Quantization (ACL 2022)
  ☆50Updated last year
• shankarp8 / knowledge_distillation
  Repository for "Propagating Knowledge Updates to LMs Through Distillation" (NeurIPS 2023).
  ☆25Updated 7 months ago
• raymin0223 / fast_robust_early_exit
  Fast and Robust Early-Exiting Framework for Autoregressive Language Models with Synchronized Parallel Decoding (EMNLP 2023 Long)
  ☆57Updated 6 months ago
• jzbjyb / ReAtt
  Retrieval as Attention
  ☆83Updated 2 years ago
• microsoft / AdaMix
  This is the implementation of the paper AdaMix: Mixture-of-Adaptations for Parameter-efficient Model Tuning (https://arxiv.org/abs/2205.1…
  ☆130Updated last year
• HanGuo97 / lq-lora
  ☆125Updated last year
• yegcjs / mixinglaws
  ☆98Updated 6 months ago
• swj0419 / in-context-pretraining
  ☆48Updated 11 months ago
• TsinghuaC3I / SoRA
  [EMNLP 2023 Main] Sparse Low-rank Adaptation of Pre-trained Language Models
  ☆72Updated last year
• arazd / ProgressivePrompts
  Progressive Prompts: Continual Learning for Language Models
  ☆92Updated last year
• FeiyuZhang98 / IncreLoRA
  ☆31Updated last year
• HKUNLP / icl-ceil
  [ICML 2023] Code for our paper “Compositional Exemplars for In-context Learning”.
  ☆98Updated 2 years ago
• ldery / Bonsai
  Code for "Everybody Prune Now: Structured Pruning of LLMs with only Forward Passes"
  ☆27Updated last year
• jongwooko / NASH-Pruning-Official
  About Code for the paper "NASH: A Simple Unified Framework of Structured Pruning for Accelerating Encoder-Decoder Language Models" (EMNLP…
  ☆15Updated last year
• Nicolas-BZRD / llm-recipes
  ☆29Updated last year
• nayeon7lee / FactualityPrompt
  ☆85Updated 2 years ago
• sanagno / adaptively_sparse_attention
  ☆20Updated last year
• cxcscmu / MATES
  Official repository for MATES: Model-Aware Data Selection for Efficient Pretraining with Data Influence Models [NeurIPS 2024]
  ☆63Updated 4 months ago
• kamanphoebe / Look-into-MoEs
  [NAACL 2025] A Closer Look into Mixture-of-Experts in Large Language Models
  ☆46Updated last month
• ChaosCodes / ProPETL
  One Network, Many Masks: Towards More Parameter-Efficient Transfer Learning
  ☆39Updated last year