allenai / molmoLinks
Code for the Molmo Vision-Language Model
☆521Updated 6 months ago
Alternatives and similar repositories for molmo
Users that are interested in molmo are comparing it to the libraries listed below
Sorting:
- LLM2CLIP makes SOTA pretrained CLIP model more SOTA ever.☆527Updated 3 months ago
- State-of-the-art Image & Video CLIP, Multimodal Large Language Models, and More!☆1,294Updated 3 weeks ago
- Video-R1: Reinforcing Video Reasoning in MLLMs [🔥the first paper to explore R1 for video]☆577Updated 3 weeks ago
- [Fully open] [Encoder-free MLLM] Vision as LoRA☆307Updated 2 weeks ago
- Official repo and evaluation implementation of VSI-Bench☆522Updated 3 months ago
- A flexible and efficient codebase for training visually-conditioned language models (VLMs)☆712Updated 11 months ago
- [ACL 2025 🔥] Rethinking Step-by-step Visual Reasoning in LLMs☆302Updated last month
- Explore the Multimodal “Aha Moment” on 2B Model☆594Updated 3 months ago
- ☆614Updated last year
- EVE Series: Encoder-Free Vision-Language Models from BAAI☆332Updated 3 months ago
- OpenVision: A Fully-Open, Cost-Effective Family of Advanced Vision Encoders for Multimodal Learning☆264Updated last month
- Compose multimodal datasets 🎹☆413Updated 2 weeks ago
- LLaVA-UHD v2: an MLLM Integrating High-Resolution Semantic Pyramid via Hierarchical Window Transformer☆380Updated 2 months ago
- [ICLR2025] LLaVA-HR: High-Resolution Large Language-Vision Assistant☆238Updated 10 months ago
- Kimi-VL: Mixture-of-Experts Vision-Language Model for Multimodal Reasoning, Long-Context Understanding, and Strong Agent Capabilities☆920Updated this week
- [ICML 2025] Official PyTorch implementation of LongVU☆383Updated last month
- Python Library to evaluate VLM models' robustness across diverse benchmarks☆208Updated last week
- [COLM-2024] List Items One by One: A New Data Source and Learning Paradigm for Multimodal LLMs☆143Updated 10 months ago
- This is the first paper to explore how to effectively use RL for MLLMs and introduce Vision-R1, a reasoning MLLM that leverages cold-sta…☆613Updated last week
- [CVPR2024] ViP-LLaVA: Making Large Multimodal Models Understand Arbitrary Visual Prompts☆324Updated 11 months ago
- A fork to add multimodal model training to open-r1☆1,309Updated 4 months ago
- This is the official code of VideoAgent: A Memory-augmented Multimodal Agent for Video Understanding (ECCV 2024)☆215Updated 6 months ago
- [CVPR 2024 🔥] Grounding Large Multimodal Model (GLaMM), the first-of-its-kind model capable of generating natural language responses tha…☆889Updated 2 weeks ago
- Project Page For "Seg-Zero: Reasoning-Chain Guided Segmentation via Cognitive Reinforcement"☆424Updated 2 weeks ago
- PyTorch Implementation of "V* : Guided Visual Search as a Core Mechanism in Multimodal LLMs"☆633Updated last year
- MM-EUREKA: Exploring the Frontiers of Multimodal Reasoning with Rule-based Reinforcement Learning☆665Updated 3 weeks ago
- When do we not need larger vision models?☆395Updated 4 months ago
- Tarsier -- a family of large-scale video-language models, which is designed to generate high-quality video descriptions , together with g…☆409Updated 2 months ago
- Official implementation of paper: SFT Memorizes, RL Generalizes: A Comparative Study of Foundation Model Post-training☆281Updated last month
- A Framework of Small-scale Large Multimodal Models☆841Updated 2 months ago