Letian2003 / MM_INFLinks
An efficient multi-modal instruction-following data synthesis tool and the official implementation of Oasis https://arxiv.org/abs/2503.08741.
☆14Updated last month
Alternatives and similar repositories for MM_INF
Users that are interested in MM_INF are comparing it to the libraries listed below
Sorting:
- MLLM-DataEngine: An Iterative Refinement Approach for MLLM☆46Updated last year
- LMM solved catastrophic forgetting, AAAI2025☆44Updated 3 months ago
- [ACM MM2025] The official repository for the RealSyn dataset☆35Updated 2 weeks ago
- A Framework for Decoupling and Assessing the Capabilities of VLMs☆44Updated last year
- SophiaVL-R1: Reinforcing MLLMs Reasoning with Thinking Reward☆57Updated 3 weeks ago
- [ACM MM25] The official code of "Breaking the Modality Barrier: Universal Embedding Learning with Multimodal LLMs"☆81Updated 2 weeks ago
- ☆73Updated last year
- WeThink: Toward General-purpose Vision-Language Reasoning via Reinforcement Learning☆31Updated last month
- [ICCV 2025] Dynamic-VLM☆23Updated 7 months ago
- [NeurIPS 2024] Vision Model Pre-training on Interleaved Image-Text Data via Latent Compression Learning☆69Updated 5 months ago
- Scaling Multi-modal Instruction Fine-tuning with Tens of Thousands Vision Task Types☆24Updated this week
- A lightweight flexible Video-MLLM developed by TencentQQ Multimedia Research Team.☆72Updated 9 months ago
- A collection of visual instruction tuning datasets.☆76Updated last year
- [NeurIPS-24] This is the official implementation of the paper "DeepStack: Deeply Stacking Visual Tokens is Surprisingly Simple and Effect…☆37Updated last year
- ☆91Updated last year
- ☆19Updated last year
- PyTorch implementation of "UNIT: Unifying Image and Text Recognition in One Vision Encoder", NeurlPS 2024.☆30Updated 9 months ago
- ☆87Updated last year
- (ACL 2025) MAmmoTH-VL: Eliciting Multimodal Reasoning with Instruction Tuning at Scale☆46Updated last month
- OpenThinkIMG is an end-to-end open-source framework that empowers Large Vision-Language Models to think with images.☆61Updated last week
- official code for "Modality Curation: Building Universal Embeddings for Advanced Multimodal Information Retrieval"☆25Updated 2 weeks ago
- MM-Instruct: Generated Visual Instructions for Large Multimodal Model Alignment☆35Updated last year
- [NeurIPS'24] Official PyTorch Implementation of Seeing the Image: Prioritizing Visual Correlation by Contrastive Alignment☆58Updated 9 months ago
- ☆84Updated 6 months ago
- [ArXiv] V2PE: Improving Multimodal Long-Context Capability of Vision-Language Models with Variable Visual Position Encoding☆51Updated 7 months ago
- Lion: Kindling Vision Intelligence within Large Language Models☆52Updated last year
- Official repository of "CoMP: Continual Multimodal Pre-training for Vision Foundation Models"☆29Updated 3 months ago
- LAVIS - A One-stop Library for Language-Vision Intelligence☆48Updated 11 months ago
- A subset of YFCC100M. Tools, checking scripts and links of web drive to download datasets(uncompressed).☆19Updated 8 months ago
- [SCIS 2024] The official implementation of the paper "MMInstruct: A High-Quality Multi-Modal Instruction Tuning Dataset with Extensive Di…☆55Updated 8 months ago