jihaonew / MM-InstructLinks
MM-Instruct: Generated Visual Instructions for Large Multimodal Model Alignment
☆35Updated last year
Alternatives and similar repositories for MM-Instruct
Users that are interested in MM-Instruct are comparing it to the libraries listed below
Sorting:
- [EMNLP 2023] TESTA: Temporal-Spatial Token Aggregation for Long-form Video-Language Understanding☆51Updated last year
- A Framework for Decoupling and Assessing the Capabilities of VLMs☆44Updated last year
- ☆73Updated last year
- ☆87Updated last month
- ☆50Updated last year
- The codebase for our EMNLP24 paper: Multimodal Self-Instruct: Synthetic Abstract Image and Visual Reasoning Instruction Using Language Mo…☆82Updated 6 months ago
- ☆85Updated 6 months ago
- [ICCV 2025] Dynamic-VLM☆23Updated 7 months ago
- [SCIS 2024] The official implementation of the paper "MMInstruct: A High-Quality Multi-Modal Instruction Tuning Dataset with Extensive Di…☆55Updated 8 months ago
- [ICLR 2025] Video-STaR: Self-Training Enables Video Instruction Tuning with Any Supervision☆66Updated last year
- Official repo for StableLLAVA☆95Updated last year
- Task Preference Optimization: Improving Multimodal Large Language Models with Vision Task Alignment☆53Updated 2 weeks ago
- Code for our Paper "All in an Aggregated Image for In-Image Learning"☆29Updated last year
- ZoomEye: Enhancing Multimodal LLMs with Human-Like Zooming Capabilities through Tree-Based Image Exploration☆47Updated 7 months ago
- SophiaVL-R1: Reinforcing MLLMs Reasoning with Thinking Reward☆72Updated last month
- [NeurIPS 2024] Efficient Large Multi-modal Models via Visual Context Compression☆60Updated 5 months ago
- ☆52Updated last month
- [AAAI2025] ChatterBox: Multi-round Multimodal Referring and Grounding, Multimodal, Multi-round dialogues☆55Updated 3 months ago
- [NeurIPS 2024] Needle In A Multimodal Haystack (MM-NIAH): A comprehensive benchmark designed to systematically evaluate the capability of…☆116Updated 8 months ago
- [ICCV 2025 Highlight] The official repository for "2.5 Years in Class: A Multimodal Textbook for Vision-Language Pretraining"☆167Updated 4 months ago
- An benchmark for evaluating the capabilities of large vision-language models (LVLMs)☆46Updated last year
- [NeurIPS-24] This is the official implementation of the paper "DeepStack: Deeply Stacking Visual Tokens is Surprisingly Simple and Effect…☆38Updated last year
- ☆66Updated last year
- [ArXiv] V2PE: Improving Multimodal Long-Context Capability of Vision-Language Models with Variable Visual Position Encoding☆54Updated 7 months ago
- ☆45Updated 7 months ago
- Official implementation of "PyVision: Agentic Vision with Dynamic Tooling."☆103Updated last week
- VideoHallucer, The first comprehensive benchmark for hallucination detection in large video-language models (LVLMs)☆36Updated 4 months ago
- ☆44Updated last year
- The official code of "VL-Rethinker: Incentivizing Self-Reflection of Vision-Language Models with Reinforcement Learning"☆131Updated 2 months ago
- Official implementation of our paper "Finetuned Multimodal Language Models are High-Quality Image-Text Data Filters".☆62Updated 3 months ago