hkproj / dpo-notesLinks
Notes on Direct Preference Optimization
☆21Updated last year
Alternatives and similar repositories for dpo-notes
Users that are interested in dpo-notes are comparing it to the libraries listed below
Sorting:
- minimal GRPO implementation from scratch☆94Updated 4 months ago
- a curated list of the role of small models in the LLM era☆103Updated 10 months ago
- ☆48Updated 11 months ago
- ☆125Updated 10 months ago
- Tina: Tiny Reasoning Models via LoRA☆274Updated 2 months ago
- Distributed training (multi-node) of a Transformer model☆76Updated last year
- Code for "Your Mixture-of-Experts LLM Is Secretly an Embedding Model For Free"☆76Updated 9 months ago
- A framework to study AI models in Reasoning, Alignment, and use of Memory (RAM).☆263Updated last week
- Organize the Web: Constructing Domains Enhances Pre-Training Data Curation☆58Updated 3 months ago
- Codebase accompanying the Summary of a Haystack paper.☆79Updated 10 months ago
- Survey: A collection of AWESOME papers and resources on the latest research in Mixture of Experts.☆128Updated 11 months ago
- Improving Text Embedding of Language Models Using Contrastive Fine-tuning☆64Updated last year
- Verifiers for LLM Reinforcement Learning☆68Updated 3 months ago
- Code for EMNLP 2024 paper "Learn Beyond The Answer: Training Language Models with Reflection for Mathematical Reasoning"☆55Updated 10 months ago
- Complex Function Calling Benchmark.☆123Updated 6 months ago
- This is the official repository for Inheritune.☆112Updated 5 months ago
- ☆76Updated last year
- Repo for "Z1: Efficient Test-time Scaling with Code"☆63Updated 3 months ago
- Advanced NLP, Spring 2025 https://cmu-l3.github.io/anlp-spring2025/☆61Updated 4 months ago
- ☆90Updated 2 months ago
- A simplified implementation for experimenting with RLVR on GSM8K, This repository provides a starting point for exploring reasoning.☆119Updated 6 months ago
- [ACL 2025] Agentic Reward Modeling: Integrating Human Preferences with Verifiable Correctness Signals for Reliable Reward Systems☆99Updated last month
- Aligning with Human Judgement: The Role of Pairwise Preference in Large Language Model Evaluators (Liu et al.; COLM 2024)☆47Updated 6 months ago
- Official Code Repository for the paper "Distilling LLM Agent into Small Models with Retrieval and Code Tools"☆130Updated this week
- Implementation of the paper: "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention" from Google in pyTO…☆56Updated last week
- NeurIPS 2024 tutorial on LLM Inference☆45Updated 7 months ago
- ☆128Updated 4 months ago
- Notes and commented code for RLHF (PPO)☆101Updated last year
- ☆64Updated last year
- Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.☆77Updated 9 months ago