allenai / molmoLinks
Code for the Molmo Vision-Language Model
☆557Updated 7 months ago
Alternatives and similar repositories for molmo
Users that are interested in molmo are comparing it to the libraries listed below
Sorting:
- State-of-the-art Image & Video CLIP, Multimodal Large Language Models, and More!☆1,431Updated this week
- LLM2CLIP makes SOTA pretrained CLIP model more SOTA ever.☆531Updated 2 weeks ago
- [Fully open] [Encoder-free MLLM] Vision as LoRA☆316Updated last month
- PyTorch Implementation of "V* : Guided Visual Search as a Core Mechanism in Multimodal LLMs"☆644Updated last year
- [ACL 2025 🔥] Rethinking Step-by-step Visual Reasoning in LLMs☆304Updated last month
- Compose multimodal datasets 🎹☆438Updated last month
- Video-R1: Reinforcing Video Reasoning in MLLMs [🔥the first paper to explore R1 for video]☆609Updated last month
- Python Library to evaluate VLM models' robustness across diverse benchmarks☆208Updated last week
- [ICML 2025] Official PyTorch implementation of LongVU☆388Updated 2 months ago
- Official repo and evaluation implementation of VSI-Bench☆541Updated 2 weeks ago
- A flexible and efficient codebase for training visually-conditioned language models (VLMs)☆730Updated last year
- ☆616Updated last year
- Visual Planning: Let's Think Only with Images☆258Updated last month
- EVE Series: Encoder-Free Vision-Language Models from BAAI☆334Updated last week
- Long Context Transfer from Language to Vision☆384Updated 3 months ago
- [ICCV 2025] OpenVision: A Fully-Open, Cost-Effective Family of Advanced Vision Encoders for Multimodal Learning☆283Updated 2 months ago
- Explore the Multimodal “Aha Moment” on 2B Model☆596Updated 3 months ago
- [CVPR2024] ViP-LLaVA: Making Large Multimodal Models Understand Arbitrary Visual Prompts☆325Updated last year
- LLaVA-UHD v2: an MLLM Integrating High-Resolution Semantic Pyramid via Hierarchical Window Transformer☆382Updated 2 months ago
- [CVPR 2024 🔥] Grounding Large Multimodal Model (GLaMM), the first-of-its-kind model capable of generating natural language responses tha…☆894Updated last month
- ✨✨[CVPR 2025] Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysis☆597Updated 2 months ago
- Tarsier -- a family of large-scale video-language models, which is designed to generate high-quality video descriptions , together with g…☆427Updated 2 months ago
- When do we not need larger vision models?☆401Updated 5 months ago
- Cosmos-Reason1 models understand the physical common sense and generate appropriate embodied decisions in natural language through long c…☆549Updated last week
- This is the official code of VideoAgent: A Memory-augmented Multimodal Agent for Video Understanding (ECCV 2024)☆221Updated 7 months ago
- A minimal codebase for finetuning large multimodal models, supporting llava-1.5/1.6, llava-interleave, llava-next-video, llava-onevision,…☆311Updated 4 months ago
- Frontier Multimodal Foundation Models for Image and Video Understanding☆899Updated last month
- An open-source implementaion for fine-tuning Qwen2-VL and Qwen2.5-VL series by Alibaba Cloud.☆940Updated last week
- This is the first paper to explore how to effectively use RL for MLLMs and introduce Vision-R1, a reasoning MLLM that leverages cold-sta…☆641Updated this week
- VideoChat-Flash: Hierarchical Compression for Long-Context Video Modeling☆444Updated last month