Alternatives and similar repositories for peft

Users that are interested in peft are comparing it to the libraries listed below

• yuzhaouoe / pretraining-data-packing
  [ACL'24 Oral] Analysing The Impact of Sequence Composition on Language Model Pre-Training
  ☆22Updated last year
• mlfoundations / scaling
  Language models scale reliably with over-training and on downstream tasks
  ☆99Updated last year
• PiotrNawrot / nano-sparse-attention
  The simplest implementation of recent Sparse Attention patterns for efficient LLM inference.
  ☆87Updated last month
• HanGuo97 / lq-lora
  ☆128Updated last year
• sjelassi / transformers_ssm_copy
  ☆33Updated last year
• ducdauge / sft-llm
  Scaling Sparse Fine-Tuning to Large Language Models
  ☆17Updated last year
• bminixhofer / zett
  Code for Zero-Shot Tokenizer Transfer
  ☆137Updated 8 months ago
• McGill-NLP / length-generalization
  Code for the paper "The Impact of Positional Encoding on Length Generalization in Transformers", NeurIPS 2023
  ☆137Updated last year
• JacobPfau / fillerTokens
  ☆72Updated last year
• kernelmachine / cbtm
  Code repository for the c-BTM paper
  ☆107Updated last year
• Leooyii / LCEG
  Long Context Extension and Generalization in LLMs
  ☆60Updated 11 months ago
• qiuzh20 / gated_attention
  The official implementation for Gated Attention for Large Language Models: Non-linearity, Sparsity, and Attention-Sink-Free
  ☆49Updated 4 months ago
• JoshEngels / MultiDimensionalFeatures
  Code for reproducing our paper "Not All Language Model Features Are Linear"
  ☆77Updated 9 months ago
• whyNLP / LCKV
  Layer-Condensed KV cache w/ 10 times larger batch size, fewer params and less computation. Dramatic speed up with better task performance…
  ☆155Updated 5 months ago
• PKU-ML / LongPPL
  Code for ICLR 2025 Paper "What is Wrong with Perplexity for Long-context Language Modeling?"
  ☆99Updated last month
• snu-mllab / Context-Memory
  Pytorch implementation for "Compressed Context Memory For Online Language Model Interaction" (ICLR'24)
  ☆62Updated last year
• RobertCsordas / moeut
  ☆85Updated last year
• SalesforceAIResearch / GemFilter
  ☆86Updated 8 months ago
• HKUNLP / STRING
  [ICLR'25] Data and code for our paper "Why Does the Effective Context Length of LLMs Fall Short?"
  ☆77Updated 9 months ago
• schwartz-lab-NLP / TOVA
  Token Omission Via Attention
  ☆128Updated 11 months ago
• justinlovelace / Diffusion-Guided-LM
  ☆27Updated last year
• ShiZhengyan / InstructionModelling
  [NeurIPS 2024 Main Track] Code for the paper titled "Instruction Tuning With Loss Over Instructions"
  ☆39Updated last year
• casmlab / NPHardEval
  Repository for NPHardEval, a quantified-dynamic benchmark of LLMs
  ☆59Updated last year
• hughbzhang / o1_inference_scaling_laws
  Replicating O1 inference-time scaling laws
  ☆89Updated 9 months ago
• VITA-Group / Ms-PoE
  "Found in the Middle: How Language Models Use Long Contexts Better via Plug-and-Play Positional Encoding" Zhenyu Zhang, Runjin Chen, Shiw…
  ☆30Updated last year
• allenai / bff
  ☆39Updated last year
• epfml / schedules-and-scaling
  Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"
  ☆82Updated 10 months ago
• UFO-101 / auto-circuit
  A library for efficient patching and automatic circuit discovery.
  ☆76Updated last month
• kyleliang919 / Online-Subspace-Descent
  [NeurIPS 2024] Low rank memory efficient optimizer without SVD
  ☆31Updated 2 months ago
• berlino / seq_icl
  ☆53Updated last year