hkproj / dpo-notesLinks
Notes on Direct Preference Optimization
☆23Updated last year
Alternatives and similar repositories for dpo-notes
Users that are interested in dpo-notes are comparing it to the libraries listed below
Sorting:
- minimal GRPO implementation from scratch☆102Updated 9 months ago
- a curated list of the role of small models in the LLM era☆111Updated last year
- [ICLR 2025 Oral] "Your Mixture-of-Experts LLM Is Secretly an Embedding Model For Free"☆86Updated last year
- Advanced NLP, Spring 2025 https://cmu-l3.github.io/anlp-spring2025/☆69Updated 9 months ago
- Survey: A collection of AWESOME papers and resources on the latest research in Mixture of Experts.☆140Updated last year
- [ACL 2025] Agentic Reward Modeling: Integrating Human Preferences with Verifiable Correctness Signals for Reliable Reward Systems☆119Updated 6 months ago
- [EMNLP'25 Industry] Repo for "Z1: Efficient Test-time Scaling with Code"☆68Updated 8 months ago
- ☆88Updated 2 months ago
- ☆77Updated 7 months ago
- Code for paper called Self-Training Elicits Concise Reasoning in Large Language Models☆41Updated 8 months ago
- ☆48Updated last year
- Distributed training (multi-node) of a Transformer model☆90Updated last year
- SSRL: Self-Search Reinforcement Learning☆201Updated 4 months ago
- A framework to study AI models in Reasoning, Alignment, and use of Memory (RAM).☆340Updated 3 weeks ago
- ☆99Updated last year
- Verifiers for LLM Reinforcement Learning☆80Updated 8 months ago
- Block Transformer: Global-to-Local Language Modeling for Fast Inference (NeurIPS 2024)☆163Updated 8 months ago
- Organize the Web: Constructing Domains Enhances Pre-Training Data Curation☆73Updated 8 months ago
- ☆112Updated last year
- ☆129Updated last year
- An extension of the nanoGPT repository for training small MOE models.☆224Updated 10 months ago
- Replicating O1 inference-time scaling laws☆91Updated last year
- NeurIPS 2024 tutorial on LLM Inference☆47Updated last year
- ☆42Updated last year
- Esoteric Language Models☆108Updated last month
- Code Implementation, Evaluations, Documentation, Links and Resources for Min P paper☆46Updated 4 months ago
- [ICML 2025] From Low Rank Gradient Subspace Stabilization to Low-Rank Weights: Observations, Theories and Applications☆52Updated 2 months ago
- [ICML 2025] Flow of Reasoning: Training LLMs for Divergent Reasoning with Minimal Examples☆113Updated 5 months ago
- ☆71Updated last year
- FastCuRL: Curriculum Reinforcement Learning with Stage-wise Context Scaling for Efficient LLM Reasoning☆55Updated 3 months ago