allenai / molmoLinks
Code for the Molmo Vision-Language Model
☆748Updated 9 months ago
Alternatives and similar repositories for molmo
Users that are interested in molmo are comparing it to the libraries listed below
Sorting:
- State-of-the-art Image & Video CLIP, Multimodal Large Language Models, and More!☆1,607Updated 2 weeks ago
- Video-R1: Reinforcing Video Reasoning in MLLMs [🔥the first paper to explore R1 for video]☆691Updated 2 weeks ago
- [Fully open] [Encoder-free MLLM] Vision as LoRA☆338Updated 3 months ago
- A flexible and efficient codebase for training visually-conditioned language models (VLMs)☆798Updated last year
- LLM2CLIP makes SOTA pretrained CLIP model more SOTA ever.☆546Updated 2 months ago
- [ICCV 2025] OpenVision: A Fully-Open, Cost-Effective Family of Advanced Vision Encoders for Multimodal Learning☆378Updated last week
- [ACL 2025 🔥] Rethinking Step-by-step Visual Reasoning in LLMs☆305Updated 4 months ago
- Explore the Multimodal “Aha Moment” on 2B Model☆608Updated 6 months ago
- Compose multimodal datasets 🎹☆478Updated last month
- Cosmos-Reason1 models understand the physical common sense and generate appropriate embodied decisions in natural language through long c…☆702Updated last week
- Official repo and evaluation implementation of VSI-Bench☆598Updated last month
- PyTorch Implementation of "V* : Guided Visual Search as a Core Mechanism in Multimodal LLMs"☆673Updated last year
- Famous Vision Language Models and Their Architectures☆1,014Updated 6 months ago
- Tarsier -- a family of large-scale video-language models, which is designed to generate high-quality video descriptions , together with g…☆470Updated last month
- ☆626Updated last year
- Python Library to evaluate VLM models' robustness across diverse benchmarks☆211Updated last week
- Kimi-VL: Mixture-of-Experts Vision-Language Model for Multimodal Reasoning, Long-Context Understanding, and Strong Agent Capabilities☆1,058Updated 2 months ago
- Projects based on SigLIP (Zhai et. al, 2023) and Hugging Face transformers integration 🤗☆275Updated 7 months ago
- When do we not need larger vision models?☆406Updated 7 months ago
- [CVPR 2024 🔥] Grounding Large Multimodal Model (GLaMM), the first-of-its-kind model capable of generating natural language responses tha…☆912Updated last month
- LLaVA-UHD v2: an MLLM Integrating High-Resolution Semantic Pyramid via Hierarchical Window Transformer☆387Updated 5 months ago
- Frontier Multimodal Foundation Models for Image and Video Understanding☆981Updated last month
- This is the first paper to explore how to effectively use R1-like RL for MLLMs and introduce Vision-R1, a reasoning MLLM that leverages …☆693Updated last week
- [ICCV 2025] Implementation for Describe Anything: Detailed Localized Image and Video Captioning☆1,333Updated 2 months ago
- [ICML 2025] Official PyTorch implementation of LongVU☆397Updated 4 months ago
- Visual Planning: Let's Think Only with Images☆271Updated 4 months ago
- Official implementation of paper: SFT Memorizes, RL Generalizes: A Comparative Study of Foundation Model Post-training☆292Updated 4 months ago
- This repo contains the code for "VLM2Vec: Training Vision-Language Models for Massive Multimodal Embedding Tasks" [ICLR 2025]☆410Updated last week
- A fork to add multimodal model training to open-r1☆1,393Updated 7 months ago
- Seed1.5-VL, a vision-language foundation model designed to advance general-purpose multimodal understanding and reasoning, achieving stat…☆1,441Updated 3 months ago