Alternatives and similar repositories for peft

Users that are interested in peft are comparing it to the libraries listed below

• yuzhaouoe / pretraining-data-packing
  [ACL'24 Oral] Analysing The Impact of Sequence Composition on Language Model Pre-Training
  ☆22Updated last year
• HanGuo97 / lq-lora
  ☆127Updated last year
• mlfoundations / scaling
  Language models scale reliably with over-training and on downstream tasks
  ☆100Updated last year
• PKU-ML / LongPPL
  Code for ICLR 2025 Paper "What is Wrong with Perplexity for Long-context Language Modeling?"
  ☆101Updated 2 months ago
• john-hewitt / backpacks-flash-attn
  The original Backpack Language Model implementation, a fork of FlashAttention
  ☆69Updated 2 years ago
• bminixhofer / zett
  Code for Zero-Shot Tokenizer Transfer
  ☆138Updated 8 months ago
• chujiezheng / LLM-Extrapolation
  Official repository for ACL 2025 paper "Model Extrapolation Expedites Alignment"
  ☆75Updated 4 months ago
• Leooyii / LCEG
  Long Context Extension and Generalization in LLMs
  ☆60Updated last year
• HazyResearch / skill-it
  Skill-It! A Data-Driven Skills Framework for Understanding and Training Language Models
  ☆47Updated last year
• HKUNLP / STRING
  [ICLR'25] Data and code for our paper "Why Does the Effective Context Length of LLMs Fall Short?"
  ☆77Updated 10 months ago
• whyNLP / LCKV
  Layer-Condensed KV cache w/ 10 times larger batch size, fewer params and less computation. Dramatic speed up with better task performance…
  ☆155Updated 6 months ago
• roeehendel / icl_task_vectors
  ☆97Updated last year
• mega002 / ff-layers
  The accompanying code for "Transformer Feed-Forward Layers Are Key-Value Memories". Mor Geva, Roei Schuster, Jonathan Berant, and Omer Le…
  ☆97Updated 4 years ago
• huggingface / ioi
  ☆39Updated 6 months ago
• JacobPfau / fillerTokens
  ☆72Updated last year
• ducdauge / sft-llm
  Scaling Sparse Fine-Tuning to Large Language Models
  ☆17Updated last year
• JonasGeiping / linear_cross_entropy_loss
  A fusion of a linear layer and a cross entropy loss, written for pytorch in triton.
  ☆70Updated last year
• GSYfate / knnlm-limits
  Official code repo for paper "Great Memory, Shallow Reasoning: Limits of kNN-LMs"
  ☆24Updated 5 months ago
• sjelassi / transformers_ssm_copy
  ☆33Updated last year
• snu-mllab / Context-Memory
  Pytorch implementation for "Compressed Context Memory For Online Language Model Interaction" (ICLR'24)
  ☆61Updated last year
• PiotrNawrot / nano-sparse-attention
  The simplest implementation of recent Sparse Attention patterns for efficient LLM inference.
  ☆89Updated 2 months ago
• huawei-noah / Efficient-NLP
  ☆95Updated last year
• QingruZhang / PASTA
  PASTA: Post-hoc Attention Steering for LLMs
  ☆122Updated 10 months ago
• Edward-Sun / gpt-accelera
  Simple and efficient pytorch-native transformer training and inference (batched)
  ☆78Updated last year
• hughbzhang / o1_inference_scaling_laws
  Replicating O1 inference-time scaling laws
  ☆90Updated 10 months ago
• princeton-nlp / HELMET
  The HELMET Benchmark
  ☆173Updated last month
• gmftbyGMFTBY / Rep-Dropout
  [NeurIPS 2023] Repetition In Repetition Out: Towards Understanding Neural Text Degeneration from the Data Perspective
  ☆36Updated last year
• ericwtodd / function_vectors
  Function Vectors in Large Language Models (ICLR 2024)
  ☆180Updated 5 months ago
• TIGER-AI-Lab / LongICLBench
  Code and Data for "Long-context LLMs Struggle with Long In-context Learning" [TMLR2025]
  ☆108Updated 7 months ago
• SalesforceAIResearch / GemFilter
  ☆86Updated 8 months ago