Alternatives and similar repositories for Awesome-Omni-MLLMs:

Users that are interested in Awesome-Omni-MLLMs are comparing it to the libraries listed below

• gyxxyg / TRACE
  [ICLR 2025] TRACE: Temporal Grounding Video LLM via Casual Event Modeling
  ☆87Updated 3 months ago
• yuezih / Movie101
  Narrative movie understanding benchmark
  ☆70Updated 11 months ago
• yuecao0119 / MMFuser
  The official implementation of the paper "MMFuser: Multimodal Multi-Layer Feature Fuser for Fine-Grained Vision-Language Understanding". …
  ☆52Updated 5 months ago
• RupertLuo / VoCoT
  VoCoT: Unleashing Visually Grounded Multi-Step Reasoning in Large Multi-Modal Models
  ☆53Updated 9 months ago
• 360CVGroup / Inner-Adaptor-Architecture
  LMM solved catastrophic forgetting, AAAI2025
  ☆40Updated last week
• JiuTian-VL / JiuTian-LION
  [CVPR 2024] LION: Empowering Multimodal Large Language Model with Dual-Level Visual Knowledge
  ☆138Updated 9 months ago
• deepglint / UniME
  The official code of "Breaking the Modality Barrier: Universal Embedding Learning with Multimodal LLMs"
  ☆27Updated this week
• JiuTian-VL / MoME
  [NeurIPS 2024] MoME: Mixture of Multimodal Experts for Generalist Multimodal Large Language Models
  ☆57Updated 4 months ago
• ZhangYiqun018 / StickerConv
  ☆45Updated 10 months ago
• rikeilong / Bay-CAT
  [ECCV’24] Official Implementation for CAT: Enhancing Multimodal Large Language Model to Answer Questions in Dynamic Audio-Visual Scenario…
  ☆52Updated 7 months ago
• phellonchen / Awesome-MLLM-Reasoning
  Latest Advances on Reasoning of Multimodal Large Language Models (Multimodal R1 \ Visual R1) ) 🍓
  ☆32Updated 3 weeks ago
• Exploring-Embodied-Emotion-official / E3
  ☆15Updated 10 months ago
• HumanMLLM / Omni-Emotion
  ☆18Updated 3 months ago
• Liuziyu77 / MMDU
  Official repository of MMDU dataset
  ☆89Updated 6 months ago
• AV-Odyssey / AV-Odyssey
  This repo contains evaluation code for the paper "AV-Odyssey: Can Your Multimodal LLMs Really Understand Audio-Visual Information?"
  ☆24Updated 4 months ago
• IDEA-FinAI / RagVL
  Official PyTorch Implementation of MLLM Is a Strong Reranker: Advancing Multimodal Retrieval-augmented Generation via Knowledge-enhanced …
  ☆69Updated 5 months ago
• foundation-multimodal-models / CAL
  [NeurIPS'24] Official PyTorch Implementation of Seeing the Image: Prioritizing Visual Correlation by Contrastive Alignment
  ☆57Updated 7 months ago
• thunlp / Muffin
  ☆63Updated last year
• HJYao00 / DenseConnector
  【NeurIPS 2024】Dense Connector for MLLMs
  ☆159Updated 6 months ago
• BriansIDP / video-SALMONN-o1
  ☆26Updated 3 weeks ago
• findalexli / mllm-dpo
  [ACL 2024] Multi-modal preference alignment remedies regression of visual instruction tuning on language model
  ☆43Updated 5 months ago
• AGI-Edgerunners / IIL
  Code for our Paper "All in an Aggregated Image for In-Image Learning"
  ☆30Updated last year
• Kwai-YuanQi / MM-RLHF
  The Next Step Forward in Multimodal LLM Alignment
  ☆145Updated last month
• Kevinz-code / SeVa
  [MM2024, oral] "Self-Supervised Visual Preference Alignment" https://arxiv.org/abs/2404.10501
  ☆56Updated 9 months ago
• RifleZhang / LLaVA-Reasoner-DPO
  ☆73Updated 3 months ago
• hshjerry / VideoEspresso
  [CVPR 2025 Oral] VideoEspresso: A Large-Scale Chain-of-Thought Dataset for Fine-Grained Video Reasoning via Core Frame Selection
  ☆74Updated 2 weeks ago
• PKU-ICST-MIPL / Finedefics_ICLR2025
  ☆51Updated this week
• MME-Benchmarks / MME-CoT
  MME-CoT: Benchmarking Chain-of-Thought in LMMs for Reasoning Quality, Robustness, and Efficiency
  ☆100Updated 3 weeks ago
• ding523 / Curr_REFT
  ☆51Updated last week
• JaaackHongggg / WorldSense
  WorldSense: Evaluating Real-world Omnimodal Understanding for Multimodal LLMs
  ☆22Updated this week