GAIR-NLP / MAYE
Rethinking RL Scaling for Vision Language Models: A Transparent, From-Scratch Framework and Comprehensive Evaluation Scheme
☆120Updated 3 weeks ago
Alternatives and similar repositories for MAYE:
Users that are interested in MAYE are comparing it to the libraries listed below
- Official code of *Virgo: A Preliminary Exploration on Reproducing o1-like MLLM*☆100Updated 2 months ago
- MMR1: Advancing the Frontiers of Multimodal Reasoning☆159Updated last month
- An Easy-to-use, Scalable and High-performance RLHF Framework designed for Multimodal Models.☆120Updated 3 weeks ago
- Exploring the Limit of Outcome Reward for Learning Mathematical Reasoning☆175Updated last month
- CPPO: Accelerating the Training of Group Relative Policy Optimization-Based Reasoning Models☆121Updated last week
- A RLHF Infrastructure for Vision-Language Models☆173Updated 5 months ago
- ☆144Updated last month
- [ArXiv] V2PE: Improving Multimodal Long-Context Capability of Vision-Language Models with Variable Visual Position Encoding☆46Updated 4 months ago
- ☆192Updated 2 months ago
- [CVPR'24] RLHF-V: Towards Trustworthy MLLMs via Behavior Alignment from Fine-grained Correctional Human Feedback☆276Updated 7 months ago
- Open-Qwen2VL: Compute-Efficient Pre-Training of Fully-Open Multimodal LLMs on Academic Resources☆190Updated last month
- ☆183Updated 3 weeks ago
- A jounery to real multimodel R1 ! We are doing on large-scale experiment☆297Updated last month
- Paper collections of multi-modal LLM for Math/STEM/Code.☆88Updated 2 weeks ago
- The official repository for "2.5 Years in Class: A Multimodal Textbook for Vision-Language Pretraining"☆152Updated last month
- A Self-Training Framework for Vision-Language Reasoning☆77Updated 3 months ago
- ☆138Updated this week
- ☆91Updated 3 weeks ago
- [NeurIPS 2024] Needle In A Multimodal Haystack (MM-NIAH): A comprehensive benchmark designed to systematically evaluate the capability of…☆116Updated 5 months ago
- Official codebase for "GenPRM: Scaling Test-Time Compute of Process Reward Models via Generative Reasoning".☆71Updated last week
- Towards Economical Inference: Enabling DeepSeek's Multi-Head Latent Attention in Any Transformer-based LLMs☆163Updated this week
- [NeurIPS 2024] CharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMs☆110Updated last week
- ☆74Updated 3 months ago
- ☆287Updated last month
- A comprehensive collection of process reward models.☆74Updated last week
- ☆115Updated last week
- The official code of "VL-Rethinker: Incentivizing Self-Reflection of Vision-Language Models with Reinforcement Learning"☆78Updated last week
- ☆111Updated this week
- The Next Step Forward in Multimodal LLM Alignment☆149Updated this week
- SFT or RL? An Early Investigation into Training R1-Like Reasoning Large Vision-Language Models☆99Updated last week