hkproj / dpo-notesLinks
Notes on Direct Preference Optimization
☆21Updated last year
Alternatives and similar repositories for dpo-notes
Users that are interested in dpo-notes are comparing it to the libraries listed below
Sorting:
- minimal GRPO implementation from scratch☆96Updated 5 months ago
- a curated list of the role of small models in the LLM era☆104Updated 11 months ago
- Code for "Your Mixture-of-Experts LLM Is Secretly an Embedding Model For Free"☆78Updated 10 months ago
- Distributed training (multi-node) of a Transformer model☆79Updated last year
- A framework to study AI models in Reasoning, Alignment, and use of Memory (RAM).☆277Updated this week
- ☆126Updated 10 months ago
- ☆48Updated 11 months ago
- SSRL: Self-Search Reinforcement Learning☆85Updated last week
- Survey: A collection of AWESOME papers and resources on the latest research in Mixture of Experts.☆129Updated last year
- ☆90Updated 3 months ago
- Notes and commented code for RLHF (PPO)☆104Updated last year
- Codebase accompanying the Summary of a Haystack paper.☆79Updated 11 months ago
- An extension of the nanoGPT repository for training small MOE models.☆178Updated 5 months ago
- [ACL 2025] Agentic Reward Modeling: Integrating Human Preferences with Verifiable Correctness Signals for Reliable Reward Systems☆101Updated 2 months ago
- Verifiers for LLM Reinforcement Learning☆71Updated 4 months ago
- A simplified implementation for experimenting with RLVR on GSM8K, This repository provides a starting point for exploring reasoning.☆121Updated 6 months ago
- ☆42Updated last year
- ☆85Updated last year
- Advanced NLP, Spring 2025 https://cmu-l3.github.io/anlp-spring2025/☆64Updated 5 months ago
- Block Transformer: Global-to-Local Language Modeling for Fast Inference (NeurIPS 2024)☆161Updated 4 months ago
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆60Updated 11 months ago
- Aligning with Human Judgement: The Role of Pairwise Preference in Large Language Model Evaluators (Liu et al.; COLM 2024)☆48Updated 7 months ago
- The official implementation for paper "Agentic-R1: Distilled Dual-Strategy Reasoning"☆94Updated last month
- RL significantly the reasoning capability of Qwen2.5-1.5B-Instruct☆30Updated 6 months ago
- Official Code Repository for the paper "Distilling LLM Agent into Small Models with Retrieval and Code Tools"☆139Updated 3 weeks ago
- nanoGRPO is a lightweight implementation of Group Relative Policy Optimization (GRPO)☆116Updated 3 months ago
- Implementation of the paper: "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention" from Google in pyTO…☆56Updated 2 weeks ago
- Repo for "Z1: Efficient Test-time Scaling with Code"☆64Updated 4 months ago
- Self-Questioning Language Models☆44Updated 3 weeks ago
- ☆66Updated last year