Shopee-MUG / MUG-ULinks
一个强大的 多模态大语言模型（MLLM），支持 文本、图像、视频等多模态输入，具备强大的理解、推理和生成能力。
☆23Updated 10 months ago
Alternatives and similar repositories for MUG-U
Users that are interested in MUG-U are comparing it to the libraries listed below
Sorting:
- [CVPR 2024] CapsFusion: Rethinking Image-Text Data at Scale☆213Updated last year
- ☆23Updated 2 years ago
- ☆87Updated last year
- ☆133Updated 2 years ago
- Lion: Kindling Vision Intelligence within Large Language Models☆51Updated last year
- MLLM-DataEngine: An Iterative Refinement Approach for MLLM☆48Updated last year
- A collection of visual instruction tuning datasets.☆76Updated last year
- ☆21Updated last year
- MM-Interleaved: Interleaved Image-Text Generative Modeling via Multi-modal Feature Synchronizer☆249Updated last year
- TaiSu（太素）--a large-scale Chinese multimodal dataset（亿级大规模中文视觉语言预训练数据集）☆189Updated 2 years ago
- SVIT: Scaling up Visual Instruction Tuning☆166Updated last year
- Scaling Multi-modal Instruction Fine-tuning with Tens of Thousands Vision Task Types☆33Updated 6 months ago
- ☆72Updated 2 years ago
- The proposed simulated dataset consisting of 9,536 charts and associated data annotations in CSV format.☆26Updated last year
- A huge dataset for Document Visual Question Answering☆20Updated last year
- [NeurIPS 2024] Vision Model Pre-training on Interleaved Image-Text Data via Latent Compression Learning☆71Updated 11 months ago
- official code for "Modality Curation: Building Universal Embeddings for Advanced Multimodal Information Retrieval"☆41Updated 6 months ago
- [NeurIPS 2024] Needle In A Multimodal Haystack (MM-NIAH): A comprehensive benchmark designed to systematically evaluate the capability of…☆120Updated last year
- Harnessing 1.4M GPT4V-synthesized Data for A Lite Vision-Language Model☆280Updated last year
- Dataset pruning for ImageNet and LAION-2B.☆79Updated last year
- ☆65Updated 7 months ago
- Touchstone: Evaluating Vision-Language Models by Language Models☆83Updated 2 years ago
- PyTorch implementation of "UNIT: Unifying Image and Text Recognition in One Vision Encoder", NeurlPS 2024.☆34Updated last year
- DenseFusion-1M: Merging Vision Experts for Comprehensive Multimodal Perception☆158Updated last year
- The official repo for “TextCoT: Zoom In for Enhanced Multimodal Text-Rich Image Understanding”.☆44Updated last year
- ☆66Updated last year
- ☆124Updated last year
- [ICLR 2025 Spotlight] OmniCorpus: A Unified Multimodal Corpus of 10 Billion-Level Images Interleaved with Text☆410Updated 8 months ago
- [ArXiv] V2PE: Improving Multimodal Long-Context Capability of Vision-Language Models with Variable Visual Position Encoding☆57Updated last year
- ☆118Updated 2 years ago