Alternatives and similar repositories for peft

Users that are interested in peft are comparing it to the libraries listed below

• r-three / RAD
  Reference implementation for Reward-Augmented Decoding: Efficient Controlled Text Generation With a Unidirectional Reward Model
  ☆43Updated last year
• ducdauge / sft-llm
  Scaling Sparse Fine-Tuning to Large Language Models
  ☆16Updated last year
• HazyResearch / aioli
  Aioli: A unified optimization framework for language model data mixing
  ☆27Updated 5 months ago
• Leooyii / LCEG
  Long Context Extension and Generalization in LLMs
  ☆57Updated 9 months ago
• kyleliang919 / Online-Subspace-Descent
  This repo is based on https://github.com/jiaweizzhao/GaLore
  ☆28Updated 9 months ago
• prateeky2806 / ComPEFT
  ☆25Updated last year
• petezh / OpenD5
  Tasks for describing differences between text distributions.
  ☆16Updated 10 months ago
• PKU-ML / LongPPL
  Code for ICLR 2025 Paper "What is Wrong with Perplexity for Long-context Language Modeling?"
  ☆88Updated last month
• facebookresearch / llm-cross-capabilities
  Official implementation for "Law of the Weakest Link: Cross capabilities of Large Language Models"
  ☆42Updated 8 months ago
• ContextualAI / CLAIR_and_APO
  Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment
  ☆57Updated 9 months ago
• katiekang1998 / reasoning_generalization
  ☆32Updated 5 months ago
• formll / resolving-scaling-law-discrepancies
  ☆20Updated 11 months ago
• sjelassi / transformers_ssm_copy
  ☆32Updated last year
• nathanhu0 / CaMeLS
  Codebase for Context-aware Meta-learned Loss Scaling (CaMeLS). https://arxiv.org/abs/2305.15076.
  ☆25Updated last year
• ltgoslo / bert-in-context
  Official implementation of "BERTs are Generative In-Context Learners"
  ☆28Updated 3 months ago
• choosewhatulike / case2code
  ☆15Updated 2 months ago
• yuzhaouoe / pretraining-data-packing
  [ACL'24 Oral] Analysing The Impact of Sequence Composition on Language Model Pre-Training
  ☆22Updated 10 months ago
• casmlab / NPHardEval
  Repository for NPHardEval, a quantified-dynamic benchmark of LLMs
  ☆54Updated last year
• justinlovelace / Diffusion-Guided-LM
  ☆27Updated 10 months ago
• mlfoundations / scaling
  Language models scale reliably with over-training and on downstream tasks
  ☆97Updated last year
• GSYfate / knnlm-limits
  Official code repo for paper "Great Memory, Shallow Reasoning: Limits of kNN-LMs"
  ☆23Updated last month
• mandyyyyii / east
  ☆18Updated 2 months ago
• sail-sg / SkyLadder
  The official repository for SkyLadder: Better and Faster Pretraining via Context Window Scheduling
  ☆32Updated 3 months ago
• jmerullo / lm_vector_arithmetic
  ☆35Updated 2 years ago
• ScalingIntelligence / large_language_monkeys
  ☆96Updated 8 months ago
• sfeucht / footprints
  https://footprints.baulab.info
  ☆17Updated 8 months ago
• ZhaofengWu / semantic-hub
  ☆16Updated 6 months ago
• qiuzh20 / gated_attention
  The official implementation for Gated Attention for Large Language Models: Non-linearity, Sparsity, and Attention-Sink-Free
  ☆44Updated last month
• neulab / data-agora
  [arXiv preprint] Official Repository for "Evaluating Language Models as Synthetic Data Generators"
  ☆33Updated 6 months ago
• john-hewitt / implicit-ins
  Codebase for Instruction Following without Instruction Tuning
  ☆34Updated 9 months ago