jinbo0906 / Awesome-MLLM-Datasets
This project aims to collect and collate various datasets for multimodal large model training, including but not limited to pre-training data, instruction fine-tuning data, and In-Context learning data.
☆17Updated 4 months ago
Alternatives and similar repositories for Awesome-MLLM-Datasets:
Users that are interested in Awesome-MLLM-Datasets are comparing it to the libraries listed below
- The official repo for “TextCoT: Zoom In for Enhanced Multimodal Text-Rich Image Understanding”.☆38Updated 4 months ago
- [ICML 2024] Memory-Space Visual Prompting for Efficient Vision-Language Fine-Tuning☆45Updated 9 months ago
- A subset of YFCC100M. Tools, checking scripts and links of web drive to download datasets(uncompressed).☆19Updated 3 months ago
- Towards Efficient and Effective Text-to-Video Retrieval with Coarse-to-Fine Visual Representation Learning☆12Updated this week
- [ICCV2023] Official code for "VL-PET: Vision-and-Language Parameter-Efficient Tuning via Granularity Control"☆53Updated last year
- The proposed simulated dataset consisting of 9,536 charts and associated data annotations in CSV format.☆21Updated last year
- ChineseCLIP using online learning☆12Updated 2 years ago
- ☆89Updated last year
- InstructionGPT-4☆39Updated last year
- The official implementation of the paper "MMFuser: Multimodal Multi-Layer Feature Fuser for Fine-Grained Vision-Language Understanding". …☆49Updated 3 months ago
- Official Codes for Fine-Grained Visual Prompting, NeurIPS 2023☆48Updated last year
- Look, Compare, Decide: Alleviating Hallucination in Large Vision-Language Models via Multi-View Multi-Path Reasoning☆19Updated 5 months ago
- [SCIS 2024] The official implementation of the paper "MMInstruct: A High-Quality Multi-Modal Instruction Tuning Dataset with Extensive Di…☆44Updated 3 months ago
- Pink: Unveiling the Power of Referential Comprehension for Multi-modal LLMs☆88Updated last month
- [EMNLP 2024] Official code for "Beyond Embeddings: The Promise of Visual Table in Multi-Modal Models"☆14Updated 4 months ago
- The official GitHub page for ''What Makes for Good Visual Instructions? Synthesizing Complex Visual Reasoning Instructions for Visual Ins…☆18Updated last year
- Code for our Paper "All in an Aggregated Image for In-Image Learning"☆29Updated 10 months ago
- A curated list of vision-and-language pre-training (VLP). :-)☆57Updated 2 years ago
- [ICCV 2023] ViLLA: Fine-grained vision-language representation learning from real-world data☆39Updated last year
- [NeurIPS 2024] MoME: Mixture of Multimodal Experts for Generalist Multimodal Large Language Models☆45Updated 2 months ago
- This repository contains the official implementation for the AAAI25 paper "From Words to Worth: Newborn Article Impact Prediction with LL…☆30Updated last month
- MLLM-DataEngine: An Iterative Refinement Approach for MLLM☆44Updated 8 months ago
- [CVPR-2023] The official dataset of Advancing Visual Grounding with Scene Knowledge: Benchmark and Method.☆29Updated last year
- ☆19Updated last year
- The codebase for our EMNLP24 paper: Multimodal Self-Instruct: Synthetic Abstract Image and Visual Reasoning Instruction Using Language Mo…☆71Updated 3 weeks ago
- An Enhanced CLIP Framework for Learning with Synthetic Captions☆26Updated 2 months ago
- Repository of paper: Position-Enhanced Visual Instruction Tuning for Multimodal Large Language Models☆37Updated last year
- [ICLR 23] Contrastive Aligned of Vision to Language Through Parameter-Efficient Transfer Learning☆38Updated last year
- VideoHallucer, The first comprehensive benchmark for hallucination detection in large video-language models (LVLMs)☆26Updated 7 months ago
- Code Release of F-LMM: Grounding Frozen Large Multimodal Models☆62Updated 6 months ago