0xallam / Direct-Preference-OptimizationLinks
Direct Preference Optimization from scratch in PyTorch
☆106Updated 4 months ago
Alternatives and similar repositories for Direct-Preference-Optimization
Users that are interested in Direct-Preference-Optimization are comparing it to the libraries listed below
Sorting:
- A Survey on Data Selection for Language Models☆247Updated 3 months ago
- Code associated with Tuning Language Models by Proxy (Liu et al., 2024)☆114Updated last year
- A simple toolkit for benchmarking LLMs on mathematical reasoning tasks. 🧮✨☆250Updated last year
- Reference implementation for Token-level Direct Preference Optimization(TDPO)☆146Updated 6 months ago
- Official repository for ACL 2025 paper "ProcessBench: Identifying Process Errors in Mathematical Reasoning"☆170Updated 3 months ago
- ☆312Updated 2 months ago
- [ACL'24] Selective Reflection-Tuning: Student-Selected Data Recycling for LLM Instruction-Tuning☆360Updated 11 months ago
- ☆280Updated 7 months ago
- Official Code Repository for LM-Steer Paper: "Word Embeddings Are Steers for Language Models" (ACL 2024 Outstanding Paper Award)☆123Updated last month
- RewardBench: the first evaluation tool for reward models.☆628Updated 2 months ago
- ☆269Updated last year
- Code for STaR: Bootstrapping Reasoning With Reasoning (NeurIPS 2022)☆209Updated 2 years ago
- ☆206Updated 6 months ago
- Awesome LLM Self-Consistency: a curated list of Self-consistency in Large Language Models☆107Updated last month
- ☆120Updated 5 months ago
- [EMNLP 2024] Source code for the paper "Learning Planning-based Reasoning with Trajectory Collection and Process Rewards Synthesizing".☆80Updated 7 months ago
- Codes and Data for Scaling Relationship on Learning Mathematical Reasoning with Large Language Models☆267Updated 11 months ago
- Critique-out-Loud Reward Models☆70Updated 10 months ago
- Project for the paper entitled `Instruction Tuning for Large Language Models: A Survey`☆182Updated 2 weeks ago
- L1: Controlling How Long A Reasoning Model Thinks With Reinforcement Learning☆248Updated 3 months ago
- The Paper List on Data Contamination for Large Language Models Evaluation.☆99Updated last week
- ☆204Updated 5 months ago
- [NeurIPS 2024] The official implementation of paper: Chain of Preference Optimization: Improving Chain-of-Thought Reasoning in LLMs.☆127Updated 5 months ago
- A brief and partial summary of RLHF algorithms.☆132Updated 5 months ago
- Model merging is a highly efficient approach for long-to-short reasoning.☆80Updated 2 months ago
- Must-read Papers on Large Language Model (LLM) Continual Learning☆144Updated last year
- A curated list of LLM Interpretability related material - Tutorial, Library, Survey, Paper, Blog, etc..☆265Updated 5 months ago
- A version of verl to support tool use☆341Updated this week
- Curation of resources for LLM mathematical reasoning, most of which are screened by @tongyx361 to ensure high quality and accompanied wit…☆136Updated last year
- The repo for In-context Autoencoder☆135Updated last year