lucasjinreal / MLLM_Factory
A Dead Simple and Modularized Multi-Modal Training and Finetune Framework. Compatible to any LLaVA/Flamingo/QwenVL/MiniGemini etc series models.
☆18Updated 11 months ago
Alternatives and similar repositories for MLLM_Factory:
Users that are interested in MLLM_Factory are comparing it to the libraries listed below
- LLaVA combines with Magvit Image tokenizer, training MLLM without an Vision Encoder. Unifying image understanding and generation.☆35Updated 9 months ago
- minisora-DiT, a DiT reproduction based on XTuner from the open source community MiniSora☆40Updated last year
- A multimodal large-scale model, which performs close to the closed-source Qwen-VL-PLUS on many datasets and significantly surpasses the p…☆14Updated last year
- MLLM-DataEngine: An Iterative Refinement Approach for MLLM☆46Updated 10 months ago
- ☆19Updated last year
- ☆17Updated last year
- Video dataset dedicated to portrait-mode video recognition.☆45Updated 3 months ago
- BTS: A Bi-lingual Benchmark for Text Segmentation in the Wild☆29Updated 11 months ago
- Multimodal Open-O1 (MO1) is designed to enhance the accuracy of inference models by utilizing a novel prompt-based approach. This tool wo…☆29Updated 6 months ago
- Empirical Study Towards Building An Effective Multi-Modal Large Language Model☆23Updated last year
- A Framework for Decoupling and Assessing the Capabilities of VLMs☆41Updated 9 months ago
- A Simple Framework of Small-scale Large Multimodal Models for Video Understanding Based on TinyLLaVA_Factory.☆46Updated last week
- ☆73Updated last year
- [ICLR 2025] IDA-VLM: Towards Movie Understanding via ID-Aware Large Vision-Language Model☆27Updated 4 months ago
- ECCV2024_Parrot Captions Teach CLIP to Spot Text☆64Updated 6 months ago
- The official repo for “TextCoT: Zoom In for Enhanced Multimodal Text-Rich Image Understanding”.☆38Updated 6 months ago
- [CVPR2023] This is an official implementation of paper "DETRs with Hybrid Matching".☆14Updated 2 years ago
- Exploring Efficient Fine-Grained Perception of Multimodal Large Language Models☆60Updated 4 months ago
- The official repository for the RealSyn dataset☆21Updated last month
- useful dotfiles included vim, zsh, tmux and vscode☆18Updated 3 months ago
- ☆91Updated last year
- ☆18Updated last year
- Lion: Kindling Vision Intelligence within Large Language Models☆52Updated last year
- ☆133Updated last year
- OpenMMLab Detection Toolbox and Benchmark for V3Det☆15Updated 11 months ago
- ☆87Updated 8 months ago
- TIP-I2V: A Million-Scale Real Text and Image Prompt Dataset for Image-to-Video Generation☆29Updated 4 months ago
- ☆21Updated last year
- Taiyi-Diffusion-XL训练代码☆21Updated 9 months ago
- ☆58Updated last year