Alternatives and similar repositories for peft

Users that are interested in peft are comparing it to the libraries listed below

• HanGuo97 / lq-lora
  ☆127Updated last year
• mlfoundations / scaling
  Language models scale reliably with over-training and on downstream tasks
  ☆100Updated last year
• yuzhaouoe / pretraining-data-packing
  [ACL'24 Oral] Analysing The Impact of Sequence Composition on Language Model Pre-Training
  ☆22Updated last year
• whyNLP / LCKV
  Layer-Condensed KV cache w/ 10 times larger batch size, fewer params and less computation. Dramatic speed up with better task performance…
  ☆155Updated 6 months ago
• huawei-noah / Efficient-NLP
  ☆95Updated last year
• hughbzhang / o1_inference_scaling_laws
  Replicating O1 inference-time scaling laws
  ☆90Updated 11 months ago
• SalesforceAIResearch / GemFilter
  ☆85Updated 9 months ago
• snu-mllab / Context-Memory
  Pytorch implementation for "Compressed Context Memory For Online Language Model Interaction" (ICLR'24)
  ☆61Updated last year
• PKU-ML / LongPPL
  Code for ICLR 2025 Paper "What is Wrong with Perplexity for Long-context Language Modeling?"
  ☆103Updated 3 weeks ago
• RobertCsordas / moeut
  ☆86Updated last year
• bminixhofer / zett
  Code for Zero-Shot Tokenizer Transfer
  ☆140Updated 9 months ago
• ducdauge / sft-llm
  Scaling Sparse Fine-Tuning to Large Language Models
  ☆17Updated last year
• Leooyii / LCEG
  Long Context Extension and Generalization in LLMs
  ☆62Updated last year
• GSYfate / knnlm-limits
  Official code repo for paper "Great Memory, Shallow Reasoning: Limits of kNN-LMs"
  ☆24Updated 6 months ago
• allenai / bff
  ☆39Updated last year
• MadryLab / DsDm
  ☆51Updated last year
• HKUNLP / STRING
  [ICLR'25] Data and code for our paper "Why Does the Effective Context Length of LLMs Fall Short?"
  ☆78Updated 11 months ago
• JonasGeiping / linear_cross_entropy_loss
  A fusion of a linear layer and a cross entropy loss, written for pytorch in triton.
  ☆69Updated last year
• PiotrNawrot / nano-sparse-attention
  The simplest implementation of recent Sparse Attention patterns for efficient LLM inference.
  ☆92Updated 3 months ago
• hadasah / btm
  ☆76Updated last year
• sjelassi / transformers_ssm_copy
  ☆34Updated last year
• TIGER-AI-Lab / LongICLBench
  Code and Data for "Long-context LLMs Struggle with Long In-context Learning" [TMLR2025]
  ☆109Updated 8 months ago
• kernelmachine / cbtm
  Code repository for the c-BTM paper
  ☆107Updated 2 years ago
• QingruZhang / PASTA
  PASTA: Post-hoc Attention Steering for LLMs
  ☆126Updated 11 months ago
• McGill-NLP / length-generalization
  Code for the paper "The Impact of Positional Encoding on Length Generalization in Transformers", NeurIPS 2023
  ☆136Updated last year
• berlino / seq_icl
  ☆53Updated last year
• HazyResearch / skill-it
  Skill-It! A Data-Driven Skills Framework for Understanding and Training Language Models
  ☆47Updated 2 years ago
• GAIR-NLP / Entropy-ABF
  Official implementation for 'Extending LLMs’ Context Window with 100 Samples'
  ☆80Updated last year
• sanyalsunny111 / LLM-Inheritune
  This is the official repository for Inheritune.
  ☆115Updated 8 months ago
• JacobPfau / fillerTokens
  ☆74Updated last year