Liuziyu77 / Visual-RFT
Official repository of ’Visual-RFT: Visual Reinforcement Fine-Tuning’
☆1,384Updated last week
Alternatives and similar repositories for Visual-RFT:
Users that are interested in Visual-RFT are comparing it to the libraries listed below
- A fork to add multimodal model training to open-r1☆1,108Updated last month
- EasyR1: An Efficient, Scalable, Multi-Modality RL Training Framework based on veRL☆1,681Updated this week
- Extend OpenRLHF to support LMM RL training for reproduction of DeepSeek-R1 on multimodal tasks.☆643Updated this week
- R1-onevision, a visual language model capable of deep CoT reasoning.☆464Updated last week
- Open-source evaluation toolkit of large multi-modality models (LMMs), support 220+ LMMs, 80+ benchmarks☆2,063Updated this week
- This is the first paper to explore how to effectively use RL for MLLMs and introduce Vision-R1, a reasoning MLLM that leverages cold-sta…☆346Updated this week
- Explore the Multimodal “Aha Moment” on 2B Model☆524Updated last week
- An open-source implementaion for fine-tuning Qwen2-VL and Qwen2.5-VL series by Alibaba Cloud.☆492Updated this week
- MM-EUREKA: Exploring Visual Aha Moment with Rule-based Large-scale Reinforcement Learning☆425Updated last week
- A Framework of Small-scale Large Multimodal Models☆775Updated last month
- Solve Visual Understanding with Reinforced VLMs☆4,305Updated this week
- This repository provides valuable reference for researchers in the field of multimodality, please start your exploratory travel in RL-bas…☆484Updated this week
- Next-Token Prediction is All You Need☆2,042Updated last week
- ☆340Updated last month
- [ICLR 2025] Repository for Show-o, One Single Transformer to Unify Multimodal Understanding and Generation.☆1,275Updated 2 weeks ago
- NeurIPS 2024 Paper: A Unified Pixel-level Vision LLM for Understanding, Generating, Segmenting, Editing☆514Updated 5 months ago
- A jounery to real multimodel R1 ! We are doing on large-scale experiment☆280Updated 2 weeks ago
- Reading notes about Multimodal Large Language Models, Large Language Models, and Diffusion Models☆328Updated last week
- ✨First Open-Source R1-like Video-LLM [2025/02/18]☆289Updated last month
- Multimodal Chain-of-Thought Reasoning: A Comprehensive Survey☆183Updated this week
- Project Page For "Seg-Zero: Reasoning-Chain Guided Segmentation via Cognitive Reinforcement"☆248Updated 2 weeks ago
- A novel Multimodal Large Language Model (MLLM) architecture, designed to structurally align visual and textual embeddings.☆838Updated last month
- Personal Project: MPP-Qwen14B & MPP-Qwen-Next(Multimodal Pipeline Parallel based on Qwen-LM). Support [video/image/multi-image] {sft/conv…☆428Updated 2 weeks ago
- ☆3,591Updated last month
- A minimal codebase for finetuning large multimodal models, supporting llava-1.5/1.6, llava-interleave, llava-next-video, llava-onevision,…☆278Updated last month
- A family of lightweight multimodal models.☆1,006Updated 4 months ago
- Reproduce R1 Zero on Logic Puzzle☆2,208Updated last week
- Frontier Multimodal Foundation Models for Image and Video Understanding☆664Updated this week
- LLaMA-VID: An Image is Worth 2 Tokens in Large Language Models (ECCV 2024)☆783Updated 7 months ago
- Pytorch implementation of Transfusion, "Predict the Next Token and Diffuse Images with One Multi-Modal Model", from MetaAI☆985Updated last week