allenai / molmoLinks
Code for the Molmo Vision-Language Model
β748Updated 9 months ago
Alternatives and similar repositories for molmo
Users that are interested in molmo are comparing it to the libraries listed below
Sorting:
- State-of-the-art Image & Video CLIP, Multimodal Large Language Models, and More!β1,607Updated 2 weeks ago
- Video-R1: Reinforcing Video Reasoning in MLLMs [π₯the first paper to explore R1 for video]β691Updated 2 weeks ago
- [Fully open] [Encoder-free MLLM] Vision as LoRAβ338Updated 3 months ago
- A flexible and efficient codebase for training visually-conditioned language models (VLMs)β798Updated last year
- LLM2CLIP makes SOTA pretrained CLIP model more SOTA ever.β546Updated 2 months ago
- [ICCV 2025] OpenVision: A Fully-Open, Cost-Effective Family of Advanced Vision Encoders for Multimodal Learningβ378Updated last week
- [ACL 2025 π₯] Rethinking Step-by-step Visual Reasoning in LLMsβ305Updated 4 months ago
- Explore the Multimodal βAha Momentβ on 2B Modelβ608Updated 6 months ago
- Compose multimodal datasets πΉβ478Updated last month
- Cosmos-Reason1 models understand the physical common sense and generate appropriate embodied decisions in natural language through long cβ¦β702Updated last week
- Official repo and evaluation implementation of VSI-Benchβ598Updated last month
- PyTorch Implementation of "V* : Guided Visual Search as a Core Mechanism in Multimodal LLMs"β673Updated last year
- Famous Vision Language Models and Their Architecturesβ1,014Updated 6 months ago
- Tarsier -- a family of large-scale video-language models, which is designed to generate high-quality video descriptions , together with gβ¦β470Updated last month
- β626Updated last year
- Python Library to evaluate VLM models' robustness across diverse benchmarksβ211Updated last week
- Kimi-VL: Mixture-of-Experts Vision-Language Model for Multimodal Reasoning, Long-Context Understanding, and Strong Agent Capabilitiesβ1,058Updated 2 months ago
- Projects based on SigLIP (Zhai et. al, 2023) and Hugging Face transformers integration π€β275Updated 7 months ago
- When do we not need larger vision models?β406Updated 7 months ago
- [CVPR 2024 π₯] Grounding Large Multimodal Model (GLaMM), the first-of-its-kind model capable of generating natural language responses thaβ¦β912Updated last month
- LLaVA-UHD v2: an MLLM Integrating High-Resolution Semantic Pyramid via Hierarchical Window Transformerβ387Updated 5 months ago
- Frontier Multimodal Foundation Models for Image and Video Understandingβ981Updated last month
- This is the first paper to explore how to effectively use R1-like RL for MLLMs and introduce Vision-R1, a reasoning MLLM that leverages β¦β693Updated last week
- [ICCV 2025] Implementation for Describe Anything: Detailed Localized Image and Video Captioningβ1,333Updated 2 months ago
- [ICML 2025] Official PyTorch implementation of LongVUβ397Updated 4 months ago
- Visual Planning: Let's Think Only with Imagesβ271Updated 4 months ago
- Official implementation of paper: SFT Memorizes, RL Generalizes: A Comparative Study of Foundation Model Post-trainingβ292Updated 4 months ago
- This repo contains the code for "VLM2Vec: Training Vision-Language Models for Massive Multimodal Embedding Tasks" [ICLR 2025]β410Updated last week
- A fork to add multimodal model training to open-r1β1,393Updated 7 months ago
- Seed1.5-VL, a vision-language foundation model designed to advance general-purpose multimodal understanding and reasoning, achieving statβ¦β1,441Updated 3 months ago