Alternatives and similar repositories for AFT:

Users that are interested in AFT are comparing it to the libraries listed below

• john-hewitt / implicit-ins
  Codebase for Instruction Following without Instruction Tuning
  ☆34Updated 7 months ago
• linkedin / ControlLLM
  Control LLM
  ☆14Updated last month
• uservan / ThinkPO
  ☆20Updated 2 months ago
• JayZhang42 / SLED
  SLED: Self Logits Evolution Decoding for Improving Factuality in Large Language Model https://arxiv.org/pdf/2411.02433
  ☆25Updated 5 months ago
• yale-nlp / refdpo
  ☆16Updated 9 months ago
• Infini-AI-Lab / S2FT
  ☆17Updated 4 months ago
• mathllm / Step-Controlled_DPO
  ☆22Updated 10 months ago
• alessiodevoto / l2compress
  Code for the EMNLP24 paper "A simple and effective L2 norm based method for KV Cache compression."
  ☆12Updated 4 months ago
• limenlp / safer-instruct
  This is the oficial repository for "Safer-Instruct: Aligning Language Models with Automated Preference Data"
  ☆17Updated last year
• bigai-nlco / CREAM
  [NeurIPS 2024] | An Efficient Recipe for Long Context Extension via Middle-Focused Positional Encoding
  ☆16Updated 7 months ago
• yihedeng9 / DuoGuard
  DuoGuard: A Two-Player RL-Driven Framework for Multilingual LLM Guardrails
  ☆21Updated 2 months ago
• ZetangForward / LCM_Stack
  Code for paper: Long cOntext aliGnment via efficient preference Optimization
  ☆13Updated 2 months ago
• open-compass / GPassK
  Official Repository of Are Your LLMs Capable of Stable Reasoning?
  ☆25Updated last month
• LAMDASZ-ML / Self-Backtracking
  ☆46Updated 2 months ago
• googleinterns / localizing-paragraph-memorization
  ☆14Updated last year
• jinzhuoran / RAG-RewardBench
  RAG-RewardBench: Benchmarking Reward Models in Retrieval Augmented Generation for Preference Alignment
  ☆16Updated 4 months ago
• hamishivi / automated-instruction-selection
  Exploration of automated dataset selection approaches at large scales.
  ☆39Updated 2 months ago
• RM-R1-UIUC / RM-R1
  ☆40Updated this week
• fangyuan-ksgk / CoT-Reasoning-without-Prompting
  Unofficial Implementation of Chain-of-Thought Reasoning Without Prompting
  ☆32Updated last year
• HypherX / Evolution-Analysis
  ☆22Updated 4 months ago
• Cohere-Labs-Community / iterative-data-selection
  ☆28Updated 6 months ago
• DAMO-NLP-SG / LongPO
  [ICLR 2025] LongPO: Long Context Self-Evolution of Large Language Models through Short-to-Long Preference Optimization
  ☆35Updated 2 months ago
• DualityRL / multi-attempt
  ☆15Updated last month
• THUDM / Self-Contrast
  Extensive Self-Contrast Enables Feedback-Free Language Model Alignment
  ☆21Updated last year
• RUCAIBox / QuantizedEmpirical
  ☆14Updated last year
• dinobby / MAGDi
  The code implementation of MAGDi: Structured Distillation of Multi-Agent Interaction Graphs Improves Reasoning in Smaller Language Models…
  ☆34Updated last year
• Reason-Wang / NAT
  [NAACL 2025] The official implementation of paper "Learning From Failure: Integrating Negative Examples when Fine-tuning Large Language M…
  ☆26Updated last year
• allenai / easy-to-hard-generalization
  Code for the arXiv preprint "The Unreasonable Effectiveness of Easy Training Data"
  ☆47Updated last year
• tianyi-lab / R2-T2
  Code for "R2-T2: Re-Routing in Test-Time for Multimodal Mixture-of-Experts"
  ☆15Updated last month
• StibiumT16 / Robust-Fine-tuning
  Code for Robust Fine-tuning (RbFT)
  ☆12Updated 3 months ago