DDPO for finetuning diffusion models, implemented in PyTorch with LoRA support
☆750Mar 22, 2024Updated 2 years ago
Alternatives and similar repositories for ddpo-pytorch
Users that are interested in ddpo-pytorch are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Code for the paper "Training Diffusion Models with Reinforcement Learning"☆558Jul 5, 2023Updated 2 years ago
- AlignProp uses direct reward backpropogation for the alignment of large-scale text-to-image diffusion models. Our method is 25x more samp…☆314Nov 1, 2024Updated last year
- [CVPR 2024] Code for the paper "Using Human Feedback to Fine-tune Diffusion Models without Any Reward Model"☆243Apr 6, 2024Updated last year
- Code for "Diffusion Model Alignment Using Direct Preference Optimization"☆671Nov 10, 2025Updated 4 months ago
- [NeurIPS 2023] ImageReward: Learning and Evaluating Human Preferences for Text-to-image Generation☆1,651Oct 29, 2025Updated 4 months ago
- DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesis☆651May 24, 2024Updated last year
- ☆23Oct 20, 2023Updated 2 years ago
- Source code for "A Dense Reward View on Aligning Text-to-Image Diffusion with Preference" (ICML'24).☆40May 9, 2024Updated last year
- [NeurIPS 2025] An official implementation of Flow-GRPO: Training Flow Matching Models via Online RL☆2,107Nov 4, 2025Updated 4 months ago
- ☆582Dec 21, 2024Updated last year
- [CVPR 2025] Aesthetic Post-Training Diffusion Models from Generic Preferences with Step-by-step Preference Optimization☆265Apr 7, 2025Updated 11 months ago
- Reproduction of DDPO paper (RLHF for diffusion)☆93Sep 20, 2023Updated 2 years ago
- Better Aligning Text-to-Image Models with Human Preference. ICCV 2023☆294Jul 14, 2023Updated 2 years ago
- official repo for "VideoScore: Building Automatic Metrics to Simulate Fine-grained Human Feedback for Video Generation" [EMNLP2024]☆114Dec 4, 2025Updated 3 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click and start building anything your business needs.
- ☆72Sep 23, 2025Updated 6 months ago
- RichHF-18K dataset contains rich human feedback labels we collected for our CVPR'24 paper: https://arxiv.org/pdf/2312.10240, along with t…☆154Jun 25, 2024Updated last year
- Official codebase for Margin-aware Preference Optimization for Aligning Diffusion Models without Reference (MaPO).☆82Jun 11, 2024Updated last year
- Code for the tutorial/review paper for RL-based-fine-tuniing. In this code, we especially focus on the design of biological sequences li…☆158Sep 15, 2024Updated last year
- Video Diffusion Alignment via Reward Gradients. We improve a variety of video diffusion models such as VideoCrafter, OpenSora, ModelScope…☆312Mar 12, 2025Updated last year
- Autoregressive Model Beats Diffusion: 🦙 Llama for Scalable Image Generation☆1,940Aug 15, 2024Updated last year
- [IJCV] FastComposer: Tuning-Free Multi-Subject Image Generation with Localized Attention☆715Jan 10, 2025Updated last year
- An official implementation of DanceGRPO: Unleashing GRPO on Visual Generation☆1,557Oct 16, 2025Updated 5 months ago
- ☆59Sep 23, 2024Updated last year
- NordVPN Special Discount Offer • AdSave on top-rated NordVPN 1 or 2-year plans with secure browsing, privacy protection, and support for for all major platforms.
- [AAAI 2026] VisionReward: Fine-Grained Multi-Dimensional Human Preference Learning for Image and Video Generation☆391Mar 26, 2025Updated last year
- [NeurIPS 2024] ReNO: Enhancing One-step Text-to-Image Models through Reward-based Noise Optimization☆166Sep 15, 2025Updated 6 months ago
- [SIGGRAPH Asia 2024] ReVersion: Diffusion-Based Relation Inversion from Images☆504Oct 7, 2025Updated 5 months ago
- Official PyTorch Implementation of "SiT: Exploring Flow and Diffusion-based Generative Models with Scalable Interpolant Transformers"☆1,129Dec 22, 2025Updated 3 months ago
- Official PyTorch Implementation of "Scalable Diffusion Models with Transformers"☆8,450May 31, 2024Updated last year
- Consistency Distilled Diff VAE☆2,212Nov 7, 2023Updated 2 years ago
- GenEval: An object-focused framework for evaluating text-to-image alignment☆435Mar 3, 2025Updated last year
- Code for "Optimizing DDPM Sampling with Shortcut Fine-Tuning" (https://arxiv.org/abs/2301.13362), ICML 2023☆30Oct 6, 2023Updated 2 years ago
- [ICLR'25 Oral] Representation Alignment for Generation: Training Diffusion Transformers Is Easier Than You Think☆1,585Mar 16, 2025Updated last year
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- A curated list of Diffusion Model in RL resources (continually updated)☆1,552Dec 15, 2025Updated 3 months ago
- CLIP+MLP Aesthetic Score Predictor☆1,268Jul 1, 2024Updated last year
- SEIKO is a novel reinforcement learning method to efficiently fine-tune diffusion models in an online setting. Our methods outperform all…☆30Jul 18, 2024Updated last year
- Official implementation for Diffusion Alignment as Sampling (DAS), ICLR'25, Spotlight☆60Feb 12, 2025Updated last year
- PyTorch implementation of MAR+DiffLoss https://arxiv.org/abs/2406.11838☆1,883Feb 20, 2026Updated last month
- [ICLR 2024] Code for FreeNoise based on VideoCrafter☆428Aug 25, 2025Updated 7 months ago
- [NeurIPS 2025] Improving Video Generation with Human Feedback☆439Sep 24, 2025Updated 6 months ago