Alternatives and similar repositories for adapters:

Users that are interested in adapters are comparing it to the libraries listed below

• AGI-Edgerunners / LLM-Adapters
  Code for our EMNLP 2023 Paper: "LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Models"
  ☆1,157Updated last year
• allenai / RL4LMs
  A modular RL library to fine-tune language models to human preferences
  ☆2,305Updated last year
• allenai / longformer
  Longformer: The Long-Document Transformer
  ☆2,118Updated 2 years ago
• thunlp / OpenDelta
  A plug-and-play library for parameter-efficient-tuning (Delta Tuning)
  ☆1,026Updated 7 months ago
• eric-mitchell / direct-preference-optimization
  Reference implementation for DPO (Direct Preference Optimization)
  ☆2,553Updated 8 months ago
• facebookresearch / DPR
  Dense Passage Retriever - is a set of tools and models for open domain Q&A task.
  ☆1,787Updated 2 years ago
• huggingface / evaluate
  🤗 Evaluate: A library for easily evaluating machine learning models and datasets.
  ☆2,199Updated 3 months ago
• google-research / t5x
  ☆2,800Updated this week
• princeton-nlp / SimCSE
  [EMNLP 2021] SimCSE: Simple Contrastive Learning of Sentence Embeddings https://arxiv.org/abs/2104.08821
  ☆3,550Updated 6 months ago
• McGill-NLP / llm2vec
  Code for 'LLM2Vec: Large Language Models Are Secretly Powerful Text Encoders'
  ☆1,500Updated 3 months ago
• huggingface / accelerate
  🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (i…
  ☆8,673Updated this week
• XiangLi1999 / PrefixTuning
  Prefix-Tuning: Optimizing Continuous Prompts for Generation
  ☆923Updated last year
• facebookresearch / fairscale
  PyTorch extensions for high performance and large scale training.
  ☆3,308Updated last week
• microsoft / torchscale
  Foundation Architecture for (M)LLMs
  ☆3,074Updated last year
• facebookresearch / multimodal
  TorchMultimodal is a PyTorch library for training state-of-the-art multimodal multi-task models at scale.
  ☆1,589Updated last week
• google-research / prompt-tuning
  Original Implementation of Prompt Tuning from Lester, et al, 2021
  ☆679Updated 2 months ago
• CarperAI / trlx
  A repo for distributed training of language models with Reinforcement Learning via Human Feedback (RLHF)
  ☆4,633Updated last year
• microsoft / DeBERTa
  The implementation of DeBERTa
  ☆2,082Updated last year
• Tiiiger / bert_score
  BERT score for text generation
  ☆1,738Updated 9 months ago
• bitsandbytes-foundation / bitsandbytes
  Accessible large language models via k-bit quantization for PyTorch.
  ☆6,972Updated this week
• laekov / fastmoe
  A fast MoE impl for PyTorch
  ☆1,713Updated 2 months ago
• lucidrains / RETRO-pytorch
  Implementation of RETRO, Deepmind's Retrieval based Attention net, in Pytorch
  ☆864Updated last year
• lucidrains / x-transformers
  A concise but complete full-attention transformer with a set of promising experimental features from various papers
  ☆5,288Updated last week
• jxhe / unify-parameter-efficient-tuning
  Implementation of paper "Towards a Unified View of Parameter-Efficient Transfer Learning" (ICLR 2022)
  ☆527Updated 3 years ago
• huggingface / trl
  Train transformer language models with reinforcement learning.
  ☆13,559Updated this week
• OpenGVLab / LLaMA-Adapter
  [ICLR 2024] Fine-tuning LLaMA to follow Instructions within 1 Hour and 1.2M Parameters
  ☆5,868Updated last year
• microsoft / ProphetNet
  A research project for natural language generation, containing the official implementations by MSRA NLC team.
  ☆721Updated 9 months ago
• beir-cellar / beir
  A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.
  ☆1,788Updated 2 months ago
• idiap / fast-transformers
  Pytorch library for fast transformer implementations
  ☆1,701Updated 2 years ago
• microsoft / LMOps
  General technology for enabling AI capabilities w/ LLMs and MLLMs
  ☆3,968Updated 2 weeks ago