[CVPR 2025] Aesthetic Post-Training Diffusion Models from Generic Preferences with Step-by-step Preference Optimization
☆271Apr 7, 2025Updated last year
Alternatives and similar repositories for SPO
Users that are interested in SPO are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [CVPR 2024] Code for the paper "Using Human Feedback to Fine-tune Diffusion Models without Any Reward Model"☆244Apr 6, 2024Updated 2 years ago
- Source code for "A Dense Reward View on Aligning Text-to-Image Diffusion with Preference" (ICML'24).☆38May 9, 2024Updated 2 years ago
- Code for "Diffusion Model Alignment Using Direct Preference Optimization"☆716Jun 2, 2026Updated 5 months ago
- Official codebase for Margin-aware Preference Optimization for Aligning Diffusion Models without Reference (MaPO).☆84Jun 11, 2024Updated 2 years ago
- The official implementation of Diffusion-KTO: Aligning Diffusion Models by Optimizing Human Utility☆67Aug 16, 2025Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆15Mar 30, 2025Updated last year
- Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesis☆680May 24, 2024Updated 2 years ago
- [NeurIPS 2024] 💫CoMat: Aligning Text-to-Image Diffusion Model with Image-to-Text Concept Matching☆168Nov 18, 2024Updated last year
- [ICLR 2025, AAAI 2026] official implementation of "Diffusion-NPO: Negative Preference Optimization for Better Preference Aligned Generati…☆40Jan 26, 2026Updated 9 months ago
- Video Diffusion Alignment via Reward Gradients. We improve a variety of video diffusion models such as VideoCrafter, OpenSora, ModelScope…☆318Mar 12, 2025Updated last year
- [AAAI 2026] VisionReward: Fine-Grained Multi-Dimensional Human Preference Learning for Image and Video Generation☆426Mar 26, 2025Updated last year
- [ACM Computing Surveys] The collection of awesome papers on alignment of diffusion models.☆430Feb 6, 2026Updated 9 months ago
- AlignProp uses direct reward backpropogation for the alignment of large-scale text-to-image diffusion models. Our method is 25x more samp…☆330Nov 1, 2024Updated 2 years ago
- [NeurIPS 2023] ImageReward: Learning and Evaluating Human Preferences for Text-to-image Generation☆1,711Oct 29, 2025Updated last year
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- ☆606Dec 21, 2024Updated last year
- ☆46May 9, 2025Updated last year
- Code and Data for Paper: SELMA: Learning and Merging Skill-Specific Text-to-Image Experts with Auto-Generated Data☆34Mar 12, 2024Updated 2 years ago
- DDPO for finetuning diffusion models, implemented in PyTorch with LoRA support☆775Mar 22, 2024Updated 2 years ago
- RichHF-18K dataset contains rich human feedback labels we collected for our CVPR'24 paper: https://arxiv.org/pdf/2312.10240, along with t…☆157Jun 25, 2024Updated 2 years ago
- [ICLR 2025] IterComp: Iterative Composition-Aware Feedback Learning from Model Gallery for Text-to-Image Generation☆203Feb 19, 2025Updated last year
- SigLIP-based Aesthetic Score Predictor☆443Dec 18, 2024Updated last year
- [ICCV 2025] ShortFT: Diffusion Model Alignment via Shortcut-based Fine-Tuning☆12Oct 17, 2026Updated 3 weeks ago
- [NeurIPS 2024] ReNO: Enhancing One-step Text-to-Image Models through Reward-based Noise Optimization☆167Sep 15, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Diffusion Model as a Noise-Aware Latent Reward Model for Step-Level Preference Optimization☆70Sep 19, 2025Updated last year
- ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignment☆1,288Jul 17, 2024Updated 2 years ago
- Official implementation of HPSv3: Towards Wide-Spectrum Human Preference Score (ICCV2025)☆369Dec 5, 2025Updated 11 months ago
- Code for the paper "Training Diffusion Models with Reinforcement Learning"☆579Jul 5, 2023Updated 3 years ago
- [ICLR 2024 Spotlight] Bounding Box Stability against Feature Dropout Reflects Detector Generalization across Environments☆20Aug 19, 2025Updated last year
- Official implementation of "Learning User Preferences for Image Generation Models"☆14Aug 16, 2025Updated last year
- ☆17Aug 13, 2024Updated 2 years ago
- [IEEE TPAMI] Code for the paper "Aligning Few-Step Diffusion Models with Dense Reward Difference Learning"☆22Feb 25, 2026Updated 8 months ago
- [NeurIPS 2024] Boosting the performance of consistency models with PCM!☆524Dec 11, 2024Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Diffusion-Sharpening: Fine-tuning Diffusion Models with Denoising Trajectory Sharpening☆72May 18, 2025Updated last year
- Official Implementation of VideoDPO☆170Jun 1, 2025Updated last year
- [ICLR 2026 Oral] DiffusionNFT: Online Diffusion Reinforcement with Forward Process☆1,121Feb 10, 2026Updated 8 months ago
- Enhancing Reward Models for High-quality Image Generation: Beyond Text-Image Alignment [ICCV 2025] - Official implementation☆45Aug 5, 2025Updated last year
- [NeurIPS 2025] An official implementation of Flow-GRPO: Training Flow Matching Models via Online RL☆2,572May 7, 2026Updated 6 months ago
- This repository is the code implementation for our paper "Step-level Reward for Free in RL-based T2I Diffusion Model Fine-tuning"☆14Jul 30, 2025Updated last year
- DyMO: Training-Free Diffusion Model Alignment with Dynamic Multi-Objective Scheduling☆12May 28, 2025Updated last year