This project aims to collect and collate various datasets for multimodal large model training, including but not limited to pre-training data, instruction fine-tuning data, and In-Context learning data.
☆78May 7, 2025Updated last year
Alternatives and similar repositories for Awesome-MLLM-Datasets
Users that are interested in Awesome-MLLM-Datasets are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆20May 14, 2024Updated 2 years ago
- Federated Meta-Learning for Emotion and Sentiment Aware Multi-modal Complaint Identification☆10May 30, 2024Updated 2 years ago
- 基于LLaVA1.6微调的Xray识别的多模态大模型☆10Oct 22, 2024Updated 2 years ago
- Visual Question Answering with Mask generation☆14Jul 27, 2025Updated last year
- Paper collections of multi-modal LLM for Math/STEM/Code.☆147Aug 30, 2026Updated 2 months ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- Fast LLM Training CodeBase With dynamic strategy choosing [Deepspeed+Megatron+FlashAttention+CudaFusionKernel+Compiler];☆42Jan 4, 2024Updated 2 years ago
- Awesome_Multimodel is a curated GitHub repository that provides a comprehensive collection of resources for Multimodal Large Language Mod…☆379Oct 15, 2026Updated 2 weeks ago
- Code for paper: Unified Text-to-Image Generation and Retrieval☆15Jul 19, 2026Updated 3 months ago
- This repository provides valuable reference for researchers in the field of multimodality, please start your exploratory travel in RL-bas…☆1,445Sep 29, 2026Updated last month
- Multi-Task instruction-tuned LLaMA☆14May 5, 2023Updated 3 years ago
- [CVPR 2025] Adaptive Markup Language Generation for Contextually-Grounded Visual Document Understanding☆17Jun 16, 2025Updated last year
- ☆111Sep 11, 2025Updated last year
- Benchmarking End-to-End Photographed Document Parsing and Translation☆18Dec 4, 2025Updated 10 months ago
- 🔨🔨🔨Tool for making model training data set☆20Nov 1, 2024Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- MLLM-DataEngine: An Iterative Refinement Approach for MLLM☆50May 24, 2024Updated 2 years ago
- [제 11회 투빅스 컨퍼런스] AM I OK ? - 전문의 답변 기반 심리진단 AI☆12Jan 19, 2021Updated 5 years ago
- A Collection of Papers on Diffusion Language Models☆189Aug 2, 2026Updated 2 months ago
- Data-Efficient Multimodal Fusion on a Single GPU☆68May 7, 2024Updated 2 years ago
- An agentic framework for omni-modal question-answer tasks.☆15Mar 30, 2026Updated 7 months ago
- Code and resources for the NeurIPS 2025 Paper "BMMR: A Large-Scale Bilingual Multimodal Multi-Discipline Reasoning Dataset" by Zhiheng X…☆18Oct 14, 2025Updated last year
- ☆14Dec 22, 2024Updated last year
- A Large-Scale Chinese Image-Text Benchmark for Real-World Short Video Search Scenarios☆14Jan 24, 2024Updated 2 years ago
- 从socket开始实现pop3和smtp客户端，实现邮件编写、发送、接收、阅读、删除等基本功能。并实现简单界面（PyQt5）Start from socket to implement pop3 and smtp clients, to realize the basic …☆12Dec 24, 2023Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Code and data for the paper: Learning Action and Reasoning-Centric Image Editing from Videos and Simulation☆37Jun 30, 2025Updated last year
- [ICLR 2024] Scaling for Training Time and Post-hoc Out-of-distribution Detection Enhancement.☆14Mar 12, 2024Updated 2 years ago
- List of Podcast Feeds using iTunes API and script to download 6,000,000~ hours of English speech.☆31Apr 13, 2023Updated 3 years ago
- 基于mineru封装的远程pdf解析服务。☆12Jul 24, 2025Updated last year
- paper list, tutorial, and nano code snippet for Diffusion Large Language Models.☆170Jan 19, 2026Updated 9 months ago
- Machine Reading Comprehension Leadboard Summary☆12Jan 4, 2021Updated 5 years ago
- CUDA MoE kernels.☆12Sep 21, 2024Updated 2 years ago
- 实验PyTorch实现了ChineseFoodNet的数据加载类，并且使用了EffiNet完成208分类任务☆11May 31, 2022Updated 4 years ago
- [ICLR 2025 Spotlight] OmniCorpus: A Unified Multimodal Corpus of 10 Billion-Level Images Interleaved with Text☆431May 5, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Awesome Reasoning in MLLMs: Papers and Projects about learning to reason with MLLMs, including Chain-of-Thought (CoT), OpenAl o1, and Dee…☆62Mar 18, 2025Updated last year
- This is for ACL 2025 Findings Paper: From Specific-MLLMs to Omni-MLLMs: A Survey on MLLMs Aligned with Multi-modalitiesModels☆104Oct 13, 2026Updated 2 weeks ago
- ☆12Mar 22, 2025Updated last year
- A Preliminary Exploration Towards General Image Restoration☆10Aug 29, 2024Updated 2 years ago
- This repo offers advanced tutorials for LLMs, BERT-based models, and multimodal models, covering fine-tuning, quantization, vocabulary ex…☆23May 5, 2025Updated last year
- [AAAI 2025] Unleashing the Potential of Model Bias for Generalized Category Discovery☆11Dec 18, 2024Updated last year
- An open-source server implementation for inference Qwen2-VL series model using fastapi.☆10Nov 20, 2024Updated last year