yihedeng9 / rlhf-summary-notes
A brief and partial summary of RLHF algorithms.
☆127Updated 2 weeks ago
Alternatives and similar repositories for rlhf-summary-notes:
Users that are interested in rlhf-summary-notes are comparing it to the libraries listed below
- Curation of resources for LLM mathematical reasoning, most of which are screened by @tongyx361 to ensure high quality and accompanied wit…☆118Updated 8 months ago
- Repo of paper "Free Process Rewards without Process Labels"☆138Updated last week
- ☆128Updated this week
- L1: Controlling How Long A Reasoning Model Thinks With Reinforcement Learning☆148Updated this week
- Easy-to-Hard Generalization: Scalable Alignment Beyond Human Supervision☆119Updated 6 months ago
- ☆96Updated 8 months ago
- ☆136Updated 4 months ago
- Homepage for ProLong (Princeton long-context language models) and paper "How to Train Long-Context Language Models (Effectively)"☆166Updated 2 weeks ago
- [NeurIPS'24 Spotlight] Observational Scaling Laws☆54Updated 5 months ago
- ☆166Updated last month
- Code for the paper "VinePPO: Unlocking RL Potential For LLM Reasoning Through Refined Credit Assignment"☆145Updated 4 months ago
- ☆260Updated last week
- Official github repo for the paper "Compression Represents Intelligence Linearly" [COLM 2024]☆130Updated 6 months ago
- What Happened in LLMs Layers when Trained for Fast vs. Slow Thinking: A Gradient Perspective☆63Updated 3 weeks ago
- ☆103Updated 2 months ago
- ☆61Updated 4 months ago
- Code for Paper (ReMax: A Simple, Efficient and Effective Reinforcement Learning Method for Aligning Large Language Models)☆178Updated last year
- [NeurIPS 2024] The official implementation of paper: Chain of Preference Optimization: Improving Chain-of-Thought Reasoning in LLMs.☆101Updated this week
- Research Code for preprint "Optimizing Test-Time Compute via Meta Reinforcement Finetuning".☆74Updated last week
- Reference implementation for Token-level Direct Preference Optimization(TDPO)☆130Updated last month
- A lightweight reproduction of DeepSeek-R1-Zero with indepth analysis of self-reflection behavior.☆212Updated this week
- ☆156Updated 2 weeks ago
- A simple toolkit for benchmarking LLMs on mathematical reasoning tasks. 🧮✨☆189Updated 10 months ago
- Function Vectors in Large Language Models (ICLR 2024)☆149Updated last week
- [NeurIPS'24] Official code for *🎯DART-Math: Difficulty-Aware Rejection Tuning for Mathematical Problem-Solving*☆98Updated 3 months ago
- A Survey on Efficient Reasoning for LLMs☆116Updated this week
- Code for "Critique Fine-Tuning: Learning to Critique is More Effective than Learning to Imitate"☆131Updated last month
- ☆83Updated last week
- Code and example data for the paper: Rule Based Rewards for Language Model Safety☆183Updated 8 months ago
- 🌾 OAT: A research-friendly framework for LLM online alignment, including preference learning, reinforcement learning, etc.☆224Updated 2 weeks ago