Alternatives and similar repositories for DEMO

Users that are interested in DEMO are comparing it to the libraries listed below

• MozerWang / AMPO
  [ICLR 2026] Adaptive Social Learning via Mode Policy Optimization for Language Agents
  ☆47Updated last week
• GuoqingWang1 / IGPO
  ☆32Updated last week
• THU-KEG / VerIF
  [EMNLP 2025] Verification Engineering for RL in Instruction Following
  ☆50Updated last month
• hkust-nlp / RL-Verifier-Robustness
  From Accuracy to Robustness: A Study of Rule- and Model-based Verifiers in Mathematical Reasoning.
  ☆24Updated 4 months ago
• jinzhuoran / RAG-RewardBench
  RAG-RewardBench: Benchmarking Reward Models in Retrieval Augmented Generation for Preference Alignment
  ☆16Updated last year
• mathllm / Step-Controlled_DPO
  ☆23Updated last year
• thu-coai / BARREL
  ☆16Updated 8 months ago
• byronBBL / Context-DPO
  Official repository of paper "Context-DPO: Aligning Language Models for Context-Faithfulness"
  ☆21Updated 11 months ago
• open-compass / ANAH
  [ACL 2024] ANAH & [NeurIPS 2024] ANAH-v2 & [ICLR 2025] Mask-DPO
  ☆62Updated 9 months ago
• GAIR-NLP / BeHonest
  BeHonest: Benchmarking Honesty in Large Language Models
  ☆34Updated last year
• WangHanLinHenry / SPA-RL-Agent
  Official code for paper "SPA-RL: Reinforcing LLM Agent via Stepwise Progress Attribution"
  ☆62Updated 5 months ago
• rookie-joe / AutoPSV
  ☆51Updated last year
• RUCKBReasoning / CoT-based-Synthesizer
  Official code implementation for the ACL 2025 paper: 'CoT-based Synthesizer: Enhancing LLM Performance through Answer Synthesis'
  ☆32Updated 8 months ago
• SparkJiao / dpo-trajectory-reasoning
  [EMNLP 2024] Source code for the paper "Learning Planning-based Reasoning with Trajectory Collection and Process Rewards Synthesizing".
  ☆83Updated last year
• YJiangcm / LTE
  [ACL 2024] Learning to Edit: Aligning LLMs with Knowledge Editing
  ☆36Updated last year
• circle-hit / SAPT
  Code for ACL 2024 accepted paper titled "SAPT: A Shared Attention Framework for Parameter-Efficient Continual Learning of Large Language …
  ☆38Updated last year
• EIT-NLP / Distilling-CoT-Reasoning
  [ACL 2025 Findings] Official implementation of the paper "Unveiling the Key Factors for Distilling Chain-of-Thought Reasoning".
  ☆20Updated 11 months ago
• cxcscmu / MATES
  Official repository for MATES: Model-Aware Data Selection for Efficient Pretraining with Data Influence Models [NeurIPS 2024]
  ☆79Updated last year
• Zayne-sprague / To-CoT-or-not-to-CoT
  ☆25Updated 10 months ago
• YJiangcm / BMC
  [ICLR 2025] Bridging and Modeling Correlations in Pairwise Data for Direct Preference Optimization
  ☆12Updated last year
• iwangjian / Midi-Tuning
  Instruct Once, Chat Consistently in Multiple Rounds: An Efficient Tuning Framework for Dialogue (ACL 2024)
  ☆25Updated 3 months ago
• ZHZisZZ / weak-to-strong-search
  [NeurIPS'24] Weak-to-Strong Search: Align Large Language Models via Searching over Small Language Models
  ☆66Updated last year
• bobxwu / learning-from-rewards-llm-papers
  A comrephensive collection of learning from rewards in the post-training and test-time scaling of LLMs, with a focus on both reward model…
  ☆63Updated 8 months ago
• OpenBMB / CPO
  ☆28Updated last year
• YiCheng98 / IntegrativeDecoding
  Official Implementation for the paper "Integrative Decoding: Improving Factuality via Implicit Self-consistency"
  ☆32Updated 10 months ago
• THU-KEG / RM-Bench
  [ICLR 25 Oral] RM-Bench: Benchmarking Reward Models of Language Models with Subtlety and Style
  ☆75Updated 6 months ago
• LHRLAB / KBQA-o1
  [ICML 2025] Official resources of "KBQA-o1: Agentic Knowledge Base Question Answering with Monte Carlo Tree Search".
  ☆34Updated 2 months ago
• junkangwu / beta-DPO
  [NeurIPS 2024] Official code of $\beta$-DPO: Direct Preference Optimization with Dynamic $\beta$
  ☆50Updated last year
• zhaochen0110 / Cotempqa
  Code and data for "Living in the Moment: Can Large Language Models Grasp Co-Temporal Reasoning?" (ACL 2024)
  ☆32Updated last year
• ShujinWu-0814 / ALOE
  Public code repo for COLING 2025 paper "Aligning LLMs with Individual Preferences via Interaction"
  ☆41Updated 10 months ago