Alternatives and similar repositories for UnifiedMLLM

Users that are interested in UnifiedMLLM are comparing it to the libraries listed below

• 360CVGroup / Inner-Adaptor-Architecture
  LMM solved catastrophic forgetting, AAAI2025
  ☆41Updated 3 weeks ago
• JaaackHongggg / WorldSense
  WorldSense: Evaluating Real-world Omnimodal Understanding for Multimodal LLMs
  ☆23Updated 3 weeks ago
• AV-Odyssey / AV-Odyssey
  This repo contains evaluation code for the paper "AV-Odyssey: Can Your Multimodal LLMs Really Understand Audio-Visual Information?"
  ☆24Updated 4 months ago
• RERV / UniAdapter
  [ICLR2024] The official implementation of paper "UniAdapter: Unified Parameter-Efficient Transfer Learning for Cross-modal Modeling", by …
  ☆74Updated last year
• BriansIDP / video-SALMONN-o1
  ☆26Updated this week
• Yui010206 / CREMA
  [ICLR 2025] CREMA: Generalizable and Efficient Video-Language Reasoning via Multimodal Modular Fusion
  ☆44Updated 3 months ago
• zehanwang01 / OmniBind
  ☆30Updated last month
• Saehyung-Lee / PlugIR
  Official repository of "Interactive Text-to-Image Retrieval with Large Language Models: A Plug-and-Play Approach" (ACL 2024 Oral)
  ☆22Updated last month
• tripletclip / TripletCLIP
  [NeurIPS 2024] Official PyTorch implementation of "Improving Compositional Reasoning of CLIP via Synthetic Vision-Language Negatives"
  ☆39Updated 5 months ago
• DAMO-NLP-SG / DiGIT
  [NeurIPS 2024] Stabilize the Latent Space for Image Autoregressive Modeling: A Unified Perspective
  ☆68Updated 6 months ago
• Gen-Verse / HermesFlow
  HermesFlow: Seamlessly Closing the Gap in Multimodal Understanding and Generation
  ☆57Updated 2 months ago
• philippe-eecs / small-vision
  A big_vision inspired repo that implements a generic Auto-Encoder class capable in representation learning and generative modeling.
  ☆35Updated 10 months ago
• thunlp / DeepPerception
  DeepPerception: Advancing R1-like Cognitive Visual Perception in MLLMs for Knowledge-Intensive Visual Grounding
  ☆52Updated last month
• LaVi-Lab / Visual-Table
  [EMNLP 2024] Official code for "Beyond Embeddings: The Promise of Visual Table in Multi-Modal Models"
  ☆17Updated 6 months ago
• haoyi-duan / DG-SCT
  NeurIPS'2023 official implementation code
  ☆62Updated last year
• Qinying-Liu / TagAlign
  Official implementation of TagAlign
  ☆34Updated 5 months ago
• Hon-Wong / ByteVideoLLM
  This is the official repo for ByteVideoLLM/Dynamic-VLM
  ☆20Updated 4 months ago
• foundation-multimodal-models / CAL
  [NeurIPS'24] Official PyTorch Implementation of Seeing the Image: Prioritizing Visual Correlation by Contrastive Alignment
  ☆57Updated 7 months ago
• ApexGen-X / MergeVQ
  [CVPR] MergeVQ: A Unified Framework for Visual Generation and Representation with Token Merging and Quantization
  ☆23Updated last month
• Yaxin9Luo / Gamma-MOD
  [ICLR2025] γ -MOD: Mixture-of-Depth Adaptation for Multimodal Large Language Models
  ☆36Updated 2 months ago
• artemisp / LAVIS-XInstructBLIP
  LAVIS - A One-stop Library for Language-Vision Intelligence
  ☆47Updated 9 months ago
• layer6ai-labs / fusemix
  Data-Efficient Multimodal Fusion on a Single GPU
  ☆59Updated last year
• csarron / PuMer
  [ACL 2023] PuMer: Pruning and Merging Tokens for Efficient Vision Language Models
  ☆29Updated 7 months ago
• locuslab / llava-token-compression
  ☆41Updated 6 months ago
• lxa9867 / QSD
  [CVPR 2024] "Towards Robust Audiovisual Segmentation in Complex Environments with Quantization-based Semantic Decomposition"
  ☆13Updated last year
• jiaangli / VLCA
  Do Vision and Language Models Share Concepts? A Vector Space Alignment Study
  ☆14Updated 5 months ago
• adobe-research / ImageFolder
  ☆17Updated 5 months ago
• sterzhang / PVIT
  Official Repository of Personalized Visual Instruct Tuning
  ☆28Updated 2 months ago
• Kevinz-code / SeVa
  [MM2024, oral] "Self-Supervised Visual Preference Alignment" https://arxiv.org/abs/2404.10501
  ☆55Updated 9 months ago
• MIO-Team / MIO
  MIO: A Foundation Model on Multimodal Tokens
  ☆25Updated 5 months ago