Alternatives and similar repositories for peft

Users that are interested in peft are comparing it to the libraries listed below

• HanGuo97 / lq-lora
  ☆128Updated last year
• yuzhaouoe / pretraining-data-packing
  [ACL'24 Oral] Analysing The Impact of Sequence Composition on Language Model Pre-Training
  ☆23Updated last year
• locuslab / massive-activations
  Code accompanying the paper "Massive Activations in Large Language Models"
  ☆187Updated last year
• JacobPfau / fillerTokens
  ☆75Updated last year
• ShiZhengyan / InstructionModelling
  [NeurIPS 2024 Main Track] Code for the paper titled "Instruction Tuning With Loss Over Instructions"
  ☆38Updated last year
• qiuzh20 / EMoE
  Official PyTorch Implementation of EMoE: Unlocking Emergent Modularity in Large Language Models [main conference @ NAACL2024]
  ☆37Updated last year
• sjelassi / transformers_ssm_copy
  ☆35Updated last year
• princeton-nlp / Edge-Pruning
  [NeurIPS 2024 Spotlight] Code and data for the paper "Finding Transformer Circuits with Edge Pruning".
  ☆63Updated 4 months ago
• PKU-ML / LongPPL
  Code for ICLR 2025 Paper "What is Wrong with Perplexity for Long-context Language Modeling?"
  ☆107Updated 2 months ago
• snu-mllab / Context-Memory
  Pytorch implementation for "Compressed Context Memory For Online Language Model Interaction" (ICLR'24)
  ☆62Updated last year
• HKUNLP / STRING
  [ICLR'25] Data and code for our paper "Why Does the Effective Context Length of LLMs Fall Short?"
  ☆78Updated last year
• r-three / smear
  ☆30Updated 2 years ago
• VITA-Group / LiGO
  [ICLR 2023] "Learning to Grow Pretrained Models for Efficient Transformer Training" by Peihao Wang, Rameswar Panda, Lucas Torroba Hennige…
  ☆92Updated last year
• Leooyii / LCEG
  Long Context Extension and Generalization in LLMs
  ☆62Updated last year
• chujiezheng / LLM-Extrapolation
  Official repository for ACL 2025 paper "Model Extrapolation Expedites Alignment"
  ☆76Updated 7 months ago
• TIGER-AI-Lab / LongICLBench
  Code and Data for "Long-context LLMs Struggle with Long In-context Learning" [TMLR2025]
  ☆110Updated 10 months ago
• epfl-dlab / llm-latent-language
  Repo accompanying our paper "Do Llamas Work in English? On the Latent Language of Multilingual Transformers".
  ☆80Updated last year
• ericwtodd / function_vectors
  Function Vectors in Large Language Models (ICLR 2024)
  ☆187Updated 8 months ago
• mlfoundations / scaling
  Language models scale reliably with over-training and on downstream tasks
  ☆100Updated last year
• MadryLab / DsDm
  ☆51Updated last year
• ducdauge / sft-llm
  Scaling Sparse Fine-Tuning to Large Language Models
  ☆18Updated last year
• benzakenelad / BitFit
  Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models
  ☆143Updated 3 years ago
• SalesforceAIResearch / GemFilter
  ☆85Updated last month
• john-hewitt / backpacks-flash-attn
  The original Backpack Language Model implementation, a fork of FlashAttention
  ☆69Updated 2 years ago
• bloomberg / dataless-model-merging
  Code release for Dataless Knowledge Fusion by Merging Weights of Language Models (https://openreview.net/forum?id=FCnohuR6AnM)
  ☆92Updated 2 years ago
• GSYfate / knnlm-limits
  Official code repo for paper "Great Memory, Shallow Reasoning: Limits of kNN-LMs"
  ☆24Updated 7 months ago
• RobertCsordas / moeut
  ☆89Updated last year
• shankarp8 / knowledge_distillation
  Repository for "Propagating Knowledge Updates to LMs Through Distillation" (NeurIPS 2023).
  ☆26Updated last year
• mega002 / ff-layers
  The accompanying code for "Transformer Feed-Forward Layers Are Key-Value Memories". Mor Geva, Roei Schuster, Jonathan Berant, and Omer Le…
  ☆99Updated 4 years ago
• xufangzhi / phi-Decoding
  [ACL 2025] An inference-time decoding strategy with adaptive foresight sampling
  ☆105Updated 7 months ago