Alternatives and similar repositories for adapters:

Users that are interested in adapters are comparing it to the libraries listed below

• microsoft / torchscale
  Foundation Architecture for (M)LLMs
  ☆3,046Updated 10 months ago
• huggingface / evaluate
  🤗 Evaluate: A library for easily evaluating machine learning models and datasets.
  ☆2,111Updated last month
• allenai / RL4LMs
  A modular RL library to fine-tune language models to human preferences
  ☆2,274Updated 11 months ago
• princeton-nlp / SimCSE
  [EMNLP 2021] SimCSE: Simple Contrastive Learning of Sentence Embeddings https://arxiv.org/abs/2104.08821
  ☆3,501Updated 4 months ago
• huggingface / accelerate
  🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (i…
  ☆8,343Updated this week
• bitsandbytes-foundation / bitsandbytes
  Accessible large language models via k-bit quantization for PyTorch.
  ☆6,679Updated this week
• allenai / longformer
  Longformer: The Long-Document Transformer
  ☆2,082Updated 2 years ago
• CarperAI / trlx
  A repo for distributed training of language models with Reinforcement Learning via Human Feedback (RLHF)
  ☆4,584Updated last year
• facebookresearch / DPR
  Dense Passage Retriever - is a set of tools and models for open domain Q&A task.
  ☆1,751Updated last year
• microsoft / DeBERTa
  The implementation of DeBERTa
  ☆2,035Updated last year
• AGI-Edgerunners / LLM-Adapters
  Code for our EMNLP 2023 Paper: "LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Models"
  ☆1,127Updated 11 months ago
• facebookresearch / fairscale
  PyTorch extensions for high performance and large scale training.
  ☆3,260Updated last month
• thunlp / OpenDelta
  A plug-and-play library for parameter-efficient-tuning (Delta Tuning)
  ☆1,013Updated 5 months ago
• Tiiiger / bert_score
  BERT score for text generation
  ☆1,674Updated 6 months ago
• facebookresearch / multimodal
  TorchMultimodal is a PyTorch library for training state-of-the-art multimodal multi-task models at scale.
  ☆1,542Updated this week
• bigscience-workshop / Megatron-DeepSpeed
  Ongoing research training transformer language models at scale, including: BERT & GPT-2
  ☆1,364Updated 11 months ago
• lucidrains / x-transformers
  A concise but complete full-attention transformer with a set of promising experimental features from various papers
  ☆5,066Updated this week
• jessevig / bertviz
  BertViz: Visualize Attention in NLP Models (BERT, GPT2, BART, etc.)
  ☆7,130Updated last year
• eric-mitchell / direct-preference-optimization
  Reference implementation for DPO (Direct Preference Optimization)
  ☆2,377Updated 6 months ago
• microsoft / ProphetNet
  A research project for natural language generation, containing the official implementations by MSRA NLC team.
  ☆705Updated 6 months ago
• XiangLi1999 / PrefixTuning
  Prefix-Tuning: Optimizing Continuous Prompts for Generation
  ☆910Updated 9 months ago
• google-research / prompt-tuning
  Original Implementation of Prompt Tuning from Lester, et al, 2021
  ☆666Updated 2 months ago
• google-research / t5x
  ☆2,749Updated 2 weeks ago
• EleutherAI / lm-evaluation-harness
  A framework for few-shot evaluation of language models.
  ☆7,848Updated this week
• thunlp / OpenPrompt
  An Open-Source Framework for Prompt-Learning.
  ☆4,462Updated 7 months ago
• laekov / fastmoe
  A fast MoE impl for PyTorch
  ☆1,624Updated last week
• AetherCortex / Llama-X
  Open Academic Research on Improving LLaMA to SOTA LLM
  ☆1,618Updated last year
• Dao-AILab / flash-attention
  Fast and memory-efficient exact attention
  ☆15,541Updated this week
• google-research / electra
  ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators
  ☆2,346Updated 10 months ago
• google-research / deduplicate-text-datasets
  ☆1,175Updated 6 months ago