lucasjinreal / MLLM_FactoryLinks
A Dead Simple and Modularized Multi-Modal Training and Finetune Framework. Compatible to any LLaVA/Flamingo/QwenVL/MiniGemini etc series models.
☆19Updated last year
Alternatives and similar repositories for MLLM_Factory
Users that are interested in MLLM_Factory are comparing it to the libraries listed below
Sorting:
- LLaVA combines with Magvit Image tokenizer, training MLLM without an Vision Encoder. Unifying image understanding and generation.☆37Updated last year
- The official repository for the RealSyn dataset☆34Updated 2 months ago
- MLLM-DataEngine: An Iterative Refinement Approach for MLLM☆46Updated last year
- ☆73Updated last year
- ☆17Updated last year
- ☆133Updated last year
- minisora-DiT, a DiT reproduction based on XTuner from the open source community MiniSora☆40Updated last year
- ☆19Updated last year
- A Simple Framework of Small-scale LMMs for Video Understanding☆65Updated 2 weeks ago
- Multimodal Open-O1 (MO1) is designed to enhance the accuracy of inference models by utilizing a novel prompt-based approach. This tool wo…☆29Updated 9 months ago
- ☆91Updated last year
- [ECCV2024] Official code implementation of Merlin: Empowering Multimodal LLMs with Foresight Minds☆94Updated 11 months ago
- [CVPR 2024] CapsFusion: Rethinking Image-Text Data at Scale☆211Updated last year
- ECCV2024_Parrot Captions Teach CLIP to Spot Text☆66Updated 9 months ago
- INF-LLaVA: Dual-perspective Perception for High-Resolution Multimodal Large Language Model☆42Updated 10 months ago
- The official implementation of our paper "Cockatiel: Ensembling Synthetic and Human Preferenced Training for Detailed Video Caption"☆33Updated last month
- VL-GPT: A Generative Pre-trained Transformer for Vision and Language Understanding and Generation☆86Updated 9 months ago
- [NeurIPS-24] This is the official implementation of the paper "DeepStack: Deeply Stacking Visual Tokens is Surprisingly Simple and Effect…☆37Updated last year
- [NeurIPS 2024] Vision Model Pre-training on Interleaved Image-Text Data via Latent Compression Learning☆69Updated 4 months ago
- [ICLR 2025] AuroraCap: Efficient, Performant Video Detailed Captioning and a New Benchmark☆111Updated 3 weeks ago
- The official repo for “TextCoT: Zoom In for Enhanced Multimodal Text-Rich Image Understanding”.☆40Updated 9 months ago
- A multimodal large-scale model, which performs close to the closed-source Qwen-VL-PLUS on many datasets and significantly surpasses the p…☆14Updated last year
- MLCD-Seg is a zero-shot segmentation model from DeepGlint.☆16Updated last month
- Empirical Study Towards Building An Effective Multi-Modal Large Language Model☆22Updated last year
- [CVPR2023] This is an official implementation of paper "DETRs with Hybrid Matching".☆14Updated 2 years ago
- [ICCV 2025] Dynamic-VLM☆20Updated 6 months ago
- ☆68Updated 2 years ago
- Exploring Efficient Fine-Grained Perception of Multimodal Large Language Models☆62Updated 7 months ago
- This repo contains the code for our paper Towards Open-Ended Visual Recognition with Large Language Model☆98Updated 11 months ago
- Code of our paper "A Unified Agentic Framework for Evaluating Conditional Image Generation".☆24Updated 2 months ago