Alternatives and similar repositories for peft

Users that are interested in peft are comparing it to the libraries listed below

• HanGuo97 / lq-lora
  ☆128Updated 2 years ago
• PKU-ML / LongPPL
  Code for ICLR 2025 Paper "What is Wrong with Perplexity for Long-context Language Modeling?"
  ☆110Updated 3 months ago
• GSYfate / knnlm-limits
  Official code repo for paper "Great Memory, Shallow Reasoning: Limits of kNN-LMs"
  ☆23Updated 9 months ago
• Leooyii / LCEG
  Long Context Extension and Generalization in LLMs
  ☆62Updated last year
• JeanKaddour / NoTrainNoGain
  Revisiting Efficient Training Algorithms For Transformer-based Language Models (NeurIPS 2023)
  ☆81Updated 2 years ago
• kyleliang919 / Online-Subspace-Descent
  [NeurIPS 2024] Low rank memory efficient optimizer without SVD
  ☆33Updated 7 months ago
• sjelassi / transformers_ssm_copy
  ☆35Updated last year
• mlfoundations / scaling
  Language models scale reliably with over-training and on downstream tasks
  ☆99Updated last year
• yuzhaouoe / pretraining-data-packing
  [ACL'24 Oral] Analysing The Impact of Sequence Composition on Language Model Pre-Training
  ☆23Updated last year
• JacobPfau / fillerTokens
  ☆75Updated last year
• HKUNLP / STRING
  [ICLR'25] Data and code for our paper "Why Does the Effective Context Length of LLMs Fall Short?"
  ☆78Updated last year
• hughbzhang / o1_inference_scaling_laws
  Replicating O1 inference-time scaling laws
  ☆91Updated last year
• MadryLab / DsDm
  ☆51Updated 2 years ago
• casmlab / NPHardEval
  Repository for NPHardEval, a quantified-dynamic benchmark of LLMs
  ☆63Updated last year
• roeehendel / icl_task_vectors
  ☆103Updated 2 years ago
• john-hewitt / backpacks-flash-attn
  The original Backpack Language Model implementation, a fork of FlashAttention
  ☆71Updated 2 years ago
• RobertCsordas / moeut
  ☆91Updated last year
• ericwtodd / function_vectors
  Function Vectors in Large Language Models (ICLR 2024)
  ☆190Updated 9 months ago
• bloomberg / dataless-model-merging
  Code release for Dataless Knowledge Fusion by Merging Weights of Language Models (https://openreview.net/forum?id=FCnohuR6AnM)
  ☆92Updated 2 years ago
• benzakenelad / BitFit
  Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models
  ☆143Updated 3 years ago
• shankarp8 / knowledge_distillation
  Repository for "Propagating Knowledge Updates to LMs Through Distillation" (NeurIPS 2023).
  ☆26Updated last year
• haonan3 / AnchorContext
  AnchorAttention: Improved attention for LLMs long-context training
  ☆213Updated last year
• SalesforceAIResearch / GemFilter
  ☆85Updated 2 months ago
• ducdauge / sft-llm
  Scaling Sparse Fine-Tuning to Large Language Models
  ☆18Updated 2 years ago
• xpq-tech / PMET
  This is a repository for "PMET: Precise Model Editing in a Transformer"
  ☆55Updated 2 years ago
• ShiZhengyan / InstructionModelling
  [NeurIPS 2024 Main Track] Code for the paper titled "Instruction Tuning With Loss Over Instructions"
  ☆38Updated last year
• xufangzhi / phi-Decoding
  [ACL 2025] An inference-time decoding strategy with adaptive foresight sampling
  ☆106Updated 8 months ago
• QingruZhang / PASTA
  PASTA: Post-hoc Attention Steering for LLMs
  ☆134Updated last year
• princeton-nlp / HELMET
  The HELMET Benchmark
  ☆198Updated last month
• TIGER-AI-Lab / LongICLBench
  Code and Data for "Long-context LLMs Struggle with Long In-context Learning" [TMLR2025]
  ☆110Updated 11 months ago