[EMNLP 2024] Introducing Filtered Direct Preference Optimization (fDPO) that enhances language model alignment with human preferences by discarding lower-quality samples compared to those generated by the learning model
☆16Nov 27, 2024Updated last year
Alternatives and similar repositories for filtered-dpo
Users that are interested in filtered-dpo are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Code of "Regularized Best-of-N Sampling with Minimum Bayes Risk Objective for Language Model Alignment" (2025).☆14Apr 4, 2025Updated last year
- ☆12Jan 2, 2024Updated 2 years ago
- Code for magnetic mirror descent.☆21Oct 5, 2023Updated 3 years ago
- Comprehensive guide to harness engineering for long-running, multi-agent AI systems☆12Feb 23, 2026Updated 8 months ago
- A working example of a 4bit QLoRA Falcon model using huggingface☆11Sep 16, 2023Updated 3 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Official Implementation of "Learning to Refuse: Towards Mitigating Privacy Risks in LLMs"☆10Dec 13, 2024Updated last year
- Public code repo for paper "Alice: Proactive Learning with Teacher's Demonstrations for Weak-to-Strong Generalization"☆10May 28, 2025Updated last year
- 🚀 First survey bridging LLM, RL, and Agentic Eras — 100+ papers on efficient inference from static generation to systematic reasoning an…☆15May 13, 2026Updated 5 months ago
- ☆10Jun 6, 2025Updated last year
- Demonstrating the usage of FGYM: A Toolkit for benchmarking FPGA-accelerated Reinforcement Learning☆14Aug 12, 2021Updated 5 years ago
- Machine translation of many to English☆13Jun 1, 2023Updated 3 years ago
- Decentralized Reinforcment Learning: Global Decision-Making via Local Economic Transactions (ICML 2020)☆43Dec 8, 2022Updated 3 years ago
- [ACL'24] Beyond One-Preference-Fits-All Alignment: Multi-Objective Direct Preference Optimization☆102Aug 20, 2024Updated 2 years ago
- [ICLR 2026]Open repository for paper "PEAR: Phase Entropy Aware Reward for Efficient Reasoning"☆12Nov 11, 2025Updated 11 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Evaluation code, tasks, prompts, and scientific tools for EarthVerse.☆12Sep 26, 2026Updated last month
- ☆14Jun 25, 2024Updated 2 years ago
- Code for the 2025 ACL publication "Fine-Tuning on Diverse Reasoning Chains Drives Within-Inference CoT Refinement in LLMs"☆33Jun 25, 2025Updated last year
- (COLING2025) SEED: Accelerating Reasoning Tree Construction via Scheduled Speculative Decoding☆10Dec 18, 2024Updated last year
- Co-Supervised Learning: Improving Weak-to-Strong Generalization with Hierarchical Mixture of Experts☆15Feb 26, 2024Updated 2 years ago
- CHAE: Fine-Grained Controllable Story Generation with Characters, Actions and Emotions☆11Jan 31, 2023Updated 3 years ago
- [ICLR 2025 SSI-FM] Self-Taught Self-Correction for Small Language Models☆11Sep 19, 2025Updated last year
- [ICASSP23] "Visual Prompting for Adversarial Robustness" by Aochuan Chen*, Peter Lorenz*, Yuguang Yao, Pin-Yu Chen, and Sijia Liu☆12Aug 12, 2023Updated 3 years ago
- [COLM 2026] An efficient 3D sampling method for long-CoT LLM.☆16May 25, 2025Updated last year
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- The code and data for "PerceptionRubrics: Calibrating Multimodal Evaluation to Human Perception" [ICML 2026]☆18Jun 30, 2026Updated 4 months ago
- Documentation at☆14Mar 27, 2025Updated last year
- The official Python SDK for FastLabel API, the Data Platform for AI☆17Oct 19, 2026Updated 2 weeks ago
- Reference implementation for Token-level Direct Preference Optimization(TDPO)☆155Feb 14, 2025Updated last year
- Deep Deterministic Policy Gradient with WebGL and CUDA☆25Jun 30, 2018Updated 8 years ago
- [ICLR 2025] This repository contains the code to reproduce the results from our paper From Sparse Dependence to Sparse Attention: Unveili…☆12Mar 7, 2025Updated last year
- ☆18Aug 4, 2025Updated last year
- Ext-Oracle Summarization: extractive summarization that maximize ROUGE w.r.t. target☆11Jun 24, 2020Updated 6 years ago
- The official implementation of NOSA (EMNLP 2026 main)☆19Sep 28, 2026Updated last month
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Store a better zsh history and search via interactive grep☆17Aug 25, 2020Updated 6 years ago
- SpanAlign: Sentence Alignment Method based on Cross-Language Span Prediction and ILP☆15Mar 24, 2021Updated 5 years ago
- ☆24Aug 10, 2022Updated 4 years ago
- Experimental tl;dr summaries for datasets on the Hugging Face Hub!☆10Apr 4, 2024Updated 2 years ago
- ☆15Oct 3, 2026Updated last month
- [EMNLP2025] Remedy: Learning Machine Translation Evaluation from Human Preferences with Reward Modeling☆16Nov 20, 2025Updated 11 months ago
- SleepCoacher recommendation engine, reference implementation for paper at http://jeffhuang.com/Final_SleepCoacher_UIST16.pdf☆26Oct 6, 2016Updated 10 years ago