Alternatives and similar repositories for adapters

Users that are interested in adapters are comparing it to the libraries listed below

• allenai / longformer
  Longformer: The Long-Document Transformer
  ☆2,174Updated 2 years ago
• huggingface / evaluate
  🤗 Evaluate: A library for easily evaluating machine learning models and datasets.
  ☆2,359Updated this week
• microsoft / torchscale
  Foundation Architecture for (M)LLMs
  ☆3,118Updated last year
• princeton-nlp / SimCSE
  [EMNLP 2021] SimCSE: Simple Contrastive Learning of Sentence Embeddings https://arxiv.org/abs/2104.08821
  ☆3,610Updated last year
• thunlp / OpenDelta
  A plug-and-play library for parameter-efficient-tuning (Delta Tuning)
  ☆1,037Updated last year
• allenai / RL4LMs
  A modular RL library to fine-tune language models to human preferences
  ☆2,366Updated last year
• facebookresearch / DPR
  Dense Passage Retriever - is a set of tools and models for open domain Q&A task.
  ☆1,843Updated 2 years ago
• AGI-Edgerunners / LLM-Adapters
  Code for our EMNLP 2023 Paper: "LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Models"
  ☆1,209Updated last year
• google-research / FLAN
  ☆1,551Updated 2 weeks ago
• facebookresearch / fairscale
  PyTorch extensions for high performance and large scale training.
  ☆3,385Updated 6 months ago
• facebookresearch / multimodal
  TorchMultimodal is a PyTorch library for training state-of-the-art multimodal multi-task models at scale.
  ☆1,666Updated this week
• XiangLi1999 / PrefixTuning
  Prefix-Tuning: Optimizing Continuous Prompts for Generation
  ☆950Updated last year
• google-research / prompt-tuning
  Original Implementation of Prompt Tuning from Lester, et al, 2021
  ☆696Updated 8 months ago
• CarperAI / trlx
  A repo for distributed training of language models with Reinforcement Learning via Human Feedback (RLHF)
  ☆4,728Updated last year
• Tiiiger / bert_score
  BERT score for text generation
  ☆1,838Updated last year
• google-research / t5x
  ☆2,907Updated last week
• bigscience-workshop / promptsource
  Toolkit for creating, sharing and using natural language prompts.
  ☆2,967Updated 2 years ago
• bigscience-workshop / Megatron-DeepSpeed
  Ongoing research training transformer language models at scale, including: BERT & GPT-2
  ☆1,427Updated last year
• bigscience-workshop / bigscience
  Central place for the engineering/scaling WG: documentation, SLURM scripts and logs, compute environment and data.
  ☆1,006Updated last year
• microsoft / DeBERTa
  The implementation of DeBERTa
  ☆2,164Updated 2 years ago
• laekov / fastmoe
  A fast MoE impl for PyTorch
  ☆1,811Updated 9 months ago
• makcedward / nlpaug
  Data augmentation for NLP
  ☆4,628Updated last year
• google-research / adapter-bert
  ☆499Updated 2 years ago
• facebookresearch / cc_net
  Tools to download and cleanup Common Crawl data
  ☆1,030Updated 2 years ago
• JonasGeiping / cramming
  Cramming the training of a (BERT-type) language model into limited compute.
  ☆1,351Updated last year
• huggingface / accelerate
  🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (i…
  ☆9,277Updated last week
• eric-mitchell / direct-preference-optimization
  Reference implementation for DPO (Direct Preference Optimization)
  ☆2,779Updated last year
• microsoft / ProphetNet
  A research project for natural language generation, containing the official implementations by MSRA NLC team.
  ☆739Updated last year
• ELS-RD / transformer-deploy
  Efficient, scalable and enterprise-grade CPU/GPU inference server for 🤗 Hugging Face transformer models 🚀
  ☆1,688Updated last year
• thunlp / PromptPapers
  Must-read papers on prompt-based tuning for pre-trained language models.
  ☆4,292Updated 2 years ago