showlab / Awesome-Unified-Multimodal-Models
π This is a repository for organizing papers, codes and other resources related to unified multimodal models.
β374Updated last month
Alternatives and similar repositories for Awesome-Unified-Multimodal-Models:
Users that are interested in Awesome-Unified-Multimodal-Models are comparing it to the libraries listed below
- π₯ Official impl. of "TokenFlow: Unified Image Tokenizer for Multimodal Understanding and Generation".β253Updated last month
- The paper collections for the autoregressive models in vision.β406Updated this week
- π₯π₯π₯ A curated list of papers on LLMs-based multimodal generation (image, video, 3D and audio).β428Updated last month
- EVE Series: Encoder-Free Vision-Language Models from BAAIβ295Updated last week
- [ICLR 2025] VILA-U: a Unified Foundation Model Integrating Visual Understanding and Generationβ227Updated 3 weeks ago
- [ICLR 2025] Diffusion Feedback Helps CLIP See Betterβ257Updated 3 weeks ago
- Official implementation of the Law of Vision Representation in MLLMsβ149Updated 3 months ago
- [Survey] Next Token Prediction Towards Multimodal Intelligence: A Comprehensive Surveyβ357Updated last month
- [ECCV 2024 Oral] Code for paper: An Image is Worth 1/2 Tokens After Layer 2: Plug-and-Play Inference Acceleration for Large Vision-Languaβ¦β364Updated last month
- [Neurips'24 Spotlight] Visual CoT: Advancing Multi-Modal Language Models with a Comprehensive Dataset and Benchmark for Chain-of-Thought β¦β234Updated last month
- Official repo for "VisionZip: Longer is Better but Not Necessary in Vision Language Models"β235Updated last month
- LaVIT: Empower the Large Language Model to Understand and Generate Visual Contentβ561Updated 4 months ago
- β308Updated last year
- [CVPR 2024 Highlight] OPERA: Alleviating Hallucination in Multi-Modal Large Language Models via Over-Trust Penalty and Retrospection-Alloβ¦β311Updated 5 months ago
- Long Context Transfer from Language to Visionβ360Updated 3 months ago
- [ICLR 2024 Spotlight] DreamLLM: Synergistic Multimodal Comprehension and Creationβ417Updated 2 months ago
- [ICLR 2025] Repository for Show-o, One Single Transformer to Unify Multimodal Understanding and Generation.β1,215Updated last week
- OmniCorpus: A Unified Multimodal Corpus of 10 Billion-Level Images Interleaved with Textβ309Updated 3 months ago
- This repo contains the code for 1D tokenizer and generatorβ691Updated last week
- [ICLR2025] LLaVA-HR: High-Resolution Large Language-Vision Assistantβ227Updated 6 months ago
- [NeurIPS 2024] This repo contains evaluation code for the paper "Are We on the Right Way for Evaluating Large Vision-Language Models"β165Updated 4 months ago
- (CVPR2024)A benchmark for evaluating Multimodal LLMs using multiple-choice questions.β328Updated last month
- β¨β¨Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysisβ460Updated 2 months ago
- A paper list of some recent works about Token Compress for Vit and VLMβ324Updated last week
- This is a repo to track the latest autoregressive visual generation papers.β139Updated last week
- SEED-Voken: A Series of Powerful Visual Tokenizersβ830Updated this week
- Reading notes about Multimodal Large Language Models, Large Language Models, and Diffusion Modelsβ250Updated this week