Alternatives and similar repositories for AFT

Users that are interested in AFT are comparing it to the libraries listed below

• john-hewitt / implicit-ins
  Codebase for Instruction Following without Instruction Tuning
  ☆35Updated last year
• zhaochenyang20 / Prompt2Model-Self-Guide
  SELF-GUIDE: Better Task-Specific Instruction Following via Self-Synthetic Finetuning. COLM 2024 Accepted Paper
  ☆33Updated last year
• uservan / ThinkPO
  ☆18Updated 2 months ago
• LAMDASZ-ML / Self-Backtracking
  ☆49Updated 7 months ago
• alessiodevoto / l2compress
  Code for the EMNLP24 paper "A simple and effective L2 norm based method for KV Cache compression."
  ☆16Updated 9 months ago
• yayayacc / MUR
  ☆45Updated last week
• yale-nlp / refdpo
  ☆15Updated last year
• open-compass / GPassK
  [ACL 2025] Are Your LLMs Capable of Stable Reasoning?
  ☆30Updated 2 months ago
• mathllm / Step-Controlled_DPO
  ☆22Updated last year
• linkedin / ControlLLM
  Control LLM
  ☆19Updated 6 months ago
• yifeiwang77 / Self-Correction
  ☆20Updated 11 months ago
• Infini-AI-Lab / S2FT
  ☆19Updated 9 months ago
• jinzhuoran / RAG-RewardBench
  RAG-RewardBench: Benchmarking Reward Models in Retrieval Augmented Generation for Preference Alignment
  ☆16Updated 9 months ago
• Cohere-Labs-Community / iterative-data-selection
  ☆30Updated 11 months ago
• GuanghaoYe / Emergence-of-Thinking
  ☆53Updated 7 months ago
• aryopg / decore
  Official Implementation of "DeCoRe: Decoding by Contrasting Retrieval Heads to Mitigate Hallucination"
  ☆25Updated 9 months ago
• JingMog / THOR
  Official Implementation of our paper "THOR: Tool-Integrated Hierarchical Optimization via RL for Mathematical Reasoning".
  ☆26Updated 2 weeks ago
• yihedeng9 / DuoGuard
  DuoGuard: A Two-Player RL-Driven Framework for Multilingual LLM Guardrails
  ☆27Updated 7 months ago
• MozerWang / AMPO
  [arxiv: 2505.02156] Adaptive Thinking via Mode Policy Optimization for Social Language Agents
  ☆44Updated 3 months ago
• DualityRL / multi-attempt
  ☆19Updated 6 months ago
• lichengliu03 / unary-feedback
  ☆38Updated last month
• tianyi-lab / Mosaic-IT
  [ACL'25] Mosaic-IT: Cost-Free Compositional Data Synthesis for Instruction Tuning
  ☆20Updated last week
• feiyang-k / AutoScale
  Official Code Repository for [AutoScale📈: Scale-Aware Data Mixing for Pre-Training LLMs] Published as a conference paper at **COLM 2025*…
  ☆12Updated 2 months ago
• rhyang2021 / ARIA
  Source code for our paper: "ARIA: Training Language Agents with Intention-Driven Reward Aggregation".
  ☆22Updated 2 months ago
• limenlp / safer-instruct
  This is the oficial repository for "Safer-Instruct: Aligning Language Models with Automated Preference Data"
  ☆17Updated last year
• hamishivi / automated-instruction-selection
  Exploration of automated dataset selection approaches at large scales.
  ☆47Updated 7 months ago
• SjJ1017 / CiteLab
  ☆16Updated 2 months ago
• LCM-Lab / LCM_Stack
  Code for paper: Long cOntext aliGnment via efficient preference Optimization
  ☆13Updated 7 months ago
• kamanphoebe / Look-into-MoEs
  [NAACL 2025] A Closer Look into Mixture-of-Experts in Large Language Models
  ☆55Updated 8 months ago
• Zayne-sprague / To-CoT-or-not-to-CoT
  ☆26Updated 5 months ago