Alternatives and similar repositories for AFT

Users that are interested in AFT are comparing it to the libraries listed below

• john-hewitt / implicit-ins
  Codebase for Instruction Following without Instruction Tuning
  ☆36Updated last year
• zhaochenyang20 / Prompt2Model-Self-Guide
  SELF-GUIDE: Better Task-Specific Instruction Following via Self-Synthetic Finetuning. COLM 2024 Accepted Paper
  ☆32Updated last year
• Infini-AI-Lab / S2FT
  ☆19Updated last year
• alessiodevoto / l2compress
  Code for the EMNLP24 paper "A simple and effective L2 norm based method for KV Cache compression."
  ☆18Updated last year
• yale-nlp / refdpo
  ☆16Updated last year
• open-compass / GPassK
  [ACL 2025] Are Your LLMs Capable of Stable Reasoning?
  ☆32Updated 6 months ago
• uservan / ThinkPO
  ☆17Updated 6 months ago
• mathllm / Step-Controlled_DPO
  ☆23Updated last year
• kamanphoebe / Look-into-MoEs
  [NAACL 2025] A Closer Look into Mixture-of-Experts in Large Language Models
  ☆58Updated last year
• LCM-Lab / LOGO
  Code for paper: Long cOntext aliGnment via efficient preference Optimization
  ☆24Updated 3 months ago
• LAMDASZ-ML / Self-Backtracking
  ☆50Updated 11 months ago
• linkedin / ControlLLM
  Control LLM
  ☆22Updated 10 months ago
• limenlp / safer-instruct
  This is the oficial repository for "Safer-Instruct: Aligning Language Models with Automated Preference Data"
  ☆17Updated last year
• sail-sg / SkyLadder
  The official repository for SkyLadder: Better and Faster Pretraining via Context Window Scheduling
  ☆42Updated last month
• David-Li0406 / SMoA
  ☆14Updated last year
• MingyuJ666 / Disentangling-Memory-and-Reasoning
  [ACL'25] We propose a novel fine-tuning method, Separate Memory and Reasoning, which combines prompt tuning with LoRA.
  ☆84Updated 3 months ago
• DAMO-NLP-SG / LongPO
  [ICLR 2025] LongPO: Long Context Self-Evolution of Large Language Models through Short-to-Long Preference Optimization
  ☆43Updated 11 months ago
• aryopg / decore
  Official Implementation of "DeCoRe: Decoding by Contrasting Retrieval Heads to Mitigate Hallucination"
  ☆27Updated last year
• jinzhuoran / RAG-RewardBench
  RAG-RewardBench: Benchmarking Reward Models in Retrieval Augmented Generation for Preference Alignment
  ☆16Updated last year
• StibiumT16 / Robust-Fine-tuning
  Code for Robust Fine-tuning (RbFT)
  ☆17Updated last year
• NuoJohnChen / JudgeLRM
  JudgeLRM: Large Reasoning Models as a Judge
  ☆40Updated last week
• GuanghaoYe / Emergence-of-Thinking
  ☆53Updated 11 months ago
• yihedeng9 / DuoGuard
  DuoGuard: A Two-Player RL-Driven Framework for Multilingual LLM Guardrails
  ☆30Updated 11 months ago
• DualityRL / multi-attempt
  ☆19Updated 10 months ago
• OPPO-PersonalAI / Flash-Searcher
  Official Implementation of Flash-Searcher: Fast and Effective Web Agents via DAG-Based Parallel Execution
  ☆64Updated 2 months ago
• abdelfattah-lab / SplitReason
  ☆21Updated 2 months ago
• multimodal-art-projection / TreePO
  ☆59Updated 3 weeks ago
• yayayacc / MUR
  ☆47Updated 4 months ago
• mathllm / MathCoder2
  ☆71Updated last year
• JingMog / THOR
  Official Implementation of our paper "THOR: Tool-Integrated Hierarchical Optimization via RL for Mathematical Reasoning".
  ☆29Updated 4 months ago