Alternatives and similar repositories for sdft

Users that are interested in sdft are comparing it to the libraries listed below

• liuqidong07 / MOELoRA-peft
  [SIGIR'24] The official implementation code of MOELoRA.
  ☆186Updated last year
• pldlgb / nuggets
  ☆87Updated last year
• RUCKBReasoning / CoT-based-Synthesizer
  Official code implementation for the ACL 2025 paper: 'CoT-based Synthesizer: Enhancing LLM Performance through Answer Synthesis'
  ☆32Updated 7 months ago
• hahahawu / Long-to-Short-via-Model-Merging
  Model merging is a highly efficient approach for long-to-short reasoning.
  ☆94Updated 2 months ago
• SparkJiao / dpo-trajectory-reasoning
  [EMNLP 2024] Source code for the paper "Learning Planning-based Reasoning with Trajectory Collection and Process Rewards Synthesizing".
  ☆83Updated 11 months ago
• tianyi-lab / Superfiltering
  [ACL'24] Superfiltering: Weak-to-Strong Data Filtering for Fast Instruction-Tuning
  ☆184Updated 5 months ago
• GCYZSL / MoLA
  ☆169Updated last year
• THU-KEG / RM-Bench
  [ICLR 25 Oral] RM-Bench: Benchmarking Reward Models of Language Models with Subtlety and Style
  ☆73Updated 5 months ago
• sanowl / OmegaPRM
  this is an implementation for the paper Improve Mathematical Reasoning in Language Models by Automated Process Supervision from google de…
  ☆44Updated 5 months ago
• HowieHwong / DataGen
  [ICLR'25] DataGen: Unified Synthetic Dataset Generation via Large Language Models
  ☆64Updated 9 months ago
• THU-KEG / AdaptThink
  ☆173Updated 2 weeks ago
• OpenMOSS / Say-I-Dont-Know
  [ICML'2024] Can AI Assistants Know What They Don't Know?
  ☆85Updated last year
• ZHZisZZ / weak-to-strong-search
  [NeurIPS'24] Weak-to-Strong Search: Align Large Language Models via Searching over Small Language Models
  ☆64Updated last year
• LightChen233 / reasoning-boundary
  ☆69Updated 6 months ago
• sail-sg / CPO
  [NeurIPS 2024] The official implementation of paper: Chain of Preference Optimization: Improving Chain-of-Thought Reasoning in LLMs.
  ☆134Updated 9 months ago
• open-compass / ANAH
  [ACL 2024] ANAH & [NeurIPS 2024] ANAH-v2 & [ICLR 2025] Mask-DPO
  ☆61Updated 7 months ago
• mtbench101 / mt-bench-101
  [ACL 2024] MT-Bench-101: A Fine-Grained Benchmark for Evaluating Large Language Models in Multi-Turn Dialogues
  ☆132Updated last year
• princeton-nlp / QuRating
  [ICML 2024] Selecting High-Quality Data for Training Language Models
  ☆197Updated 2 weeks ago
• yyDing1 / ScaleQuest
  [ACL 2025] We introduce ScaleQuest, a scalable, novel and cost-effective data synthesis method to unleash the reasoning capability of LLM…
  ☆68Updated last year
• SihengLi99 / LLM-Honesty-Survey
  [2025-TMLR] A Survey on the Honesty of Large Language Models
  ☆64Updated last year
• OrangeInSouth / DeePEn
  A method of ensemble learning for heterogeneous large language models.
  ☆64Updated last year
• dongguanting / DPA-RAG
  The code and data of DPA-RAG, accepted by WWW 2025 main conference.
  ☆63Updated 2 months ago
• PKU-Alignment / aligner
  [NeurIPS 2024 Oral] Aligner: Efficient Alignment by Learning to Correct
  ☆191Updated 11 months ago
• hemingkx / TokenSkip
  [EMNLP 2025] TokenSkip: Controllable Chain-of-Thought Compression in LLMs
  ☆197Updated 3 weeks ago
• ZitongYang / Synthetic_Continued_Pretraining
  Code implementation of synthetic continued pretraining
  ☆144Updated 11 months ago
• MozerWang / Loong
  [EMNLP 2024 (Oral)] Leave No Document Behind: Benchmarking Long-Context LLMs with Extended Multi-Doc QA
  ☆143Updated last year
• circle-hit / SAPT
  Code for ACL 2024 accepted paper titled "SAPT: A Shared Attention Framework for Parameter-Efficient Continual Learning of Large Language …
  ☆38Updated 11 months ago
• xiatingyu / SFT-DataSelection-at-scale
  ☆32Updated 10 months ago
• ZNLP / Language-Imbalance-Driven-Rewarding
  [ICLR 2025] Language Imbalance Driven Rewarding for Multilingual Self-improving
  ☆24Updated 3 months ago
• weizhepei / InstructRAG
  [ICLR 2025] InstructRAG: Instructing Retrieval-Augmented Generation via Self-Synthesized Rationales
  ☆134Updated 10 months ago