The Next Step Forward in Multimodal LLM Alignment
☆199May 1, 2025Updated last year
Alternatives and similar repositories for MM-RLHF
Users that are interested in MM-RLHF are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Sparrow: Data-Efficient Video-LLM with Text-to-Image Augmentation☆32Mar 28, 2025Updated last year
- ✨✨ [ICLR 2026] R1-Reward: Training Multimodal Reward Model Through Stable Reinforcement Learning☆293May 9, 2025Updated last year
- ✨✨Long-VITA: Scaling Large Multi-modal Models to 1 Million Tokens with Leading Short-Context Accuracy☆306May 14, 2025Updated last year
- ✨✨ [ICLR 2026] MME-Unify: A Comprehensive Benchmark for Unified Multimodal Understanding and Generation Models☆43Apr 10, 2025Updated last year
- ✨✨ [ICLR 2025] MME-RealWorld: Could Your Multimodal LLM Challenge High-Resolution Real-World Scenarios that are Difficult for Humans?☆161Oct 21, 2025Updated 9 months ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- ✨✨[AAAI 2026] This is the official implementation of our paper "QuoTA: Query-oriented Token Assignment via CoT Query Decouple for Long Vi…☆79Apr 28, 2025Updated last year
- Video-MME-v2: Towards the Next Stage in Benchmarks for Comprehensive Video Understanding☆365Aug 5, 2026Updated last week
- ☆30May 21, 2026Updated 2 months ago
- ✨✨[CVPR 2025] Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysis☆789Dec 8, 2025Updated 8 months ago
- [CVPR 2026 Highlight] PersonaVLM: Long-Term Personalized Multimodal LLMs☆116Apr 16, 2026Updated 4 months ago
- ✨✨Beyond LLaVA-HD: Diving into High-Resolution Large Multimodal Models☆163Dec 26, 2024Updated last year
- ✨✨[NeurIPS 2025] VITA-1.5: Towards GPT-4o Level Real-Time Vision and Speech Interaction☆2,527Mar 28, 2025Updated last year
- Aligning LMMs with Factually Augmented RLHF☆398Nov 1, 2023Updated 2 years ago
- VideoDetective: Clue Hunting via both Extrinsic Query and Intrinsic Relevance for Long Video Understanding☆57May 1, 2026Updated 3 months ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- [CVPR'25 highlight] RLAIF-V: Open-Source AI Feedback Leads to Super GPT-4V Trustworthiness☆459May 14, 2025Updated last year
- Multimodal RewardBench☆68Feb 21, 2025Updated last year
- MME-CoT: Benchmarking Chain-of-Thought in LMMs for Reasoning Quality, Robustness, and Efficiency☆136Aug 5, 2025Updated last year
- ☆40May 28, 2025Updated last year
- ✨✨ [ICLR 2026] Think Beyond Images☆582Sep 23, 2025Updated 10 months ago
- Scaling Multi-modal Instruction Fine-tuning with Tens of Thousands Vision Task Types☆32Jul 16, 2025Updated last year
- ✨✨[NeurIPS 2025] This is the official implementation of our paper "Video-RAG: Visually-aligned Retrieval-Augmented Long Video Comprehensi…☆454Jun 26, 2026Updated last month
- [CVPR 2024] Aligning and Prompting Everything All at Once for Universal Visual Perception☆609May 8, 2024Updated 2 years ago
- ☆28Oct 10, 2025Updated 10 months ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- EvoEmbedding: Evolvable Representations for Long-Context Retrieval and Agentic Memory☆54Jul 24, 2026Updated 3 weeks ago
- The official implement of VITA, VITA15, LongVITA, VITA-Audio, VITA-VLA, and VITA-E.☆164Oct 28, 2025Updated 9 months ago
- ☆38Jul 9, 2024Updated 2 years ago
- A fork to add multimodal model training to open-r1☆1,600Feb 8, 2025Updated last year
- Extend OpenRLHF to support LMM RL training for reproduction of DeepSeek-R1 on multimodal tasks.☆848May 14, 2025Updated last year
- ✨✨Freeze-Omni: A Smart and Low Latency Speech-to-speech Dialogue Model with Frozen LLM☆393May 27, 2025Updated last year
- Official implementation of UnifiedReward & [NeurIPS 2025] UnifiedReward-Think & UnifiedReward-Flex☆800Jun 18, 2026Updated 2 months ago
- ✨✨[ICML 2026] Omni-Diffusion: Unified Multimodal Understanding and Generation with Masked Discrete Diffusion☆153Mar 12, 2026Updated 5 months ago
- MM-EUREKA: Exploring the Frontiers of Multimodal Reasoning with Rule-based Reinforcement Learning☆770Sep 7, 2025Updated 11 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- R1-onevision, a visual language model capable of deep CoT reasoning.☆582Apr 13, 2025Updated last year
- Official repository of 'Visual-RFT: Visual Reinforcement Fine-Tuning' & 'Visual-ARFT: Visual Agentic Reinforcement Fine-Tuning'’☆2,268Oct 29, 2025Updated 9 months ago
- Reading notes about Multimodal Large Language Models, Large Language Models, and Diffusion Models☆1,193Jul 14, 2026Updated last month
- Repo for paper "T2Vid: Translating Long Text into Multi-Image is the Catalyst for Video-LLMs"☆48Sep 3, 2025Updated 11 months ago
- ☆808Jun 10, 2026Updated 2 months ago
- VITA-QINYU: Expressive Spoken Language Model for Role-Playing and Singing☆123Jul 14, 2026Updated last month
- [ICML 2025] Official code of "DAMA: Data- and Model-aware Alignment of Multi-modal LLMs"☆16May 24, 2025Updated last year