hkproj / dpo-notesLinks
Notes on Direct Preference Optimization
☆23Updated last year
Alternatives and similar repositories for dpo-notes
Users that are interested in dpo-notes are comparing it to the libraries listed below
Sorting:
- minimal GRPO implementation from scratch☆98Updated 7 months ago
- a curated list of the role of small models in the LLM era☆105Updated last year
- Distributed training (multi-node) of a Transformer model☆85Updated last year
- A framework to study AI models in Reasoning, Alignment, and use of Memory (RAM).☆295Updated this week
- SSRL: Self-Search Reinforcement Learning☆147Updated 2 months ago
- The official implementation of the paper "What Matters in Transformers? Not All Attention is Needed".☆177Updated 7 months ago
- [ICLR 2025 Oral] "Your Mixture-of-Experts LLM Is Secretly an Embedding Model For Free"☆82Updated last year
- SLED: Self Logits Evolution Decoding for Improving Factuality in Large Language Model https://arxiv.org/pdf/2411.02433☆107Updated 10 months ago
- ☆128Updated last year
- Survey: A collection of AWESOME papers and resources on the latest research in Mixture of Experts.☆135Updated last year
- ☆48Updated last year
- ☆77Updated 2 months ago
- [EMNLP'2025 Industry] Repo for "Z1: Efficient Test-time Scaling with Code"☆65Updated 6 months ago
- This is the official repository for Inheritune.☆115Updated 8 months ago
- [ACL 2025] Agentic Reward Modeling: Integrating Human Preferences with Verifiable Correctness Signals for Reliable Reward Systems☆108Updated 4 months ago
- Verifiers for LLM Reinforcement Learning☆77Updated 6 months ago
- ☆98Updated last year
- Tina: Tiny Reasoning Models via LoRA☆299Updated last month
- Organize the Web: Constructing Domains Enhances Pre-Training Data Curation☆67Updated 5 months ago
- ☆108Updated last year
- ☆99Updated 5 months ago
- Code for EMNLP 2024 paper "Learn Beyond The Answer: Training Language Models with Reflection for Mathematical Reasoning"☆55Updated last year
- Systematic evaluation framework that automatically rates overthinking behavior in large language models.☆93Updated 5 months ago
- [NeurIPS 2025] Reinforcement Learning for Reasoning in Large Language Models with One Training Example☆365Updated 2 weeks ago
- [ICLR 2025] DSBench: How Far are Data Science Agents from Becoming Data Science Experts?☆78Updated 2 months ago
- [NeurIPS 2024 Main Track] Code for the paper titled "Instruction Tuning With Loss Over Instructions"☆39Updated last year
- Advanced NLP, Spring 2025 https://cmu-l3.github.io/anlp-spring2025/☆66Updated 7 months ago
- Codebase accompanying the Summary of a Haystack paper.☆79Updated last year
- Code for "Critique Fine-Tuning: Learning to Critique is More Effective than Learning to Imitate" [COLM 2025]☆178Updated 3 months ago
- Process Reward Models That Think☆59Updated 2 weeks ago