Alternatives and similar repositories for UnifiedMLLM

Users that are interested in UnifiedMLLM are comparing it to the libraries listed below

• AV-Odyssey / AV-Odyssey
  This repo contains evaluation code for the paper "AV-Odyssey: Can Your Multimodal LLMs Really Understand Audio-Visual Information?"
  ☆26Updated 6 months ago
• BriansIDP / video-SALMONN-o1
  ☆32Updated 3 weeks ago
• JaaackHongggg / WorldSense
  WorldSense: Evaluating Real-world Omnimodal Understanding for Multimodal LLMs
  ☆25Updated 2 months ago
• lxa9867 / QSD
  [CVPR 2024] "Towards Robust Audiovisual Segmentation in Complex Environments with Quantization-based Semantic Decomposition"
  ☆13Updated last year
• DAMO-NLP-SG / DiGIT
  [NeurIPS 2024] Stabilize the Latent Space for Image Autoregressive Modeling: A Unified Perspective
  ☆69Updated 7 months ago
• Saehyung-Lee / PlugIR
  Official repository of "Interactive Text-to-Image Retrieval with Large Language Models: A Plug-and-Play Approach" (ACL 2024 Oral)
  ☆26Updated 3 months ago
• 360CVGroup / Inner-Adaptor-Architecture
  LMM solved catastrophic forgetting, AAAI2025
  ☆43Updated 2 months ago
• RERV / UniAdapter
  [ICLR2024] The official implementation of paper "UniAdapter: Unified Parameter-Efficient Transfer Learning for Cross-modal Modeling", by …
  ☆74Updated last year
• Yui010206 / CREMA
  [ICLR 2025] CREMA: Generalizable and Efficient Video-Language Reasoning via Multimodal Modular Fusion
  ☆46Updated 5 months ago
• tripletclip / TripletCLIP
  [NeurIPS 2024] Official PyTorch implementation of "Improving Compositional Reasoning of CLIP via Synthetic Vision-Language Negatives"
  ☆41Updated 6 months ago
• dongzhuoyao / uspace
  An official pytorch implementation of AAAI 2024 paper "Latent Space Editing in Transformer-based Flow Matching"
  ☆42Updated last year
• zehanwang01 / OmniBind
  ☆32Updated 2 months ago
• locuslab / llava-token-compression
  ☆42Updated 7 months ago
• ytaek-oh / fsc-clip
  [EMNLP 2024] Preserving Multi-Modal Capabilities of Pre-trained VLMs for Improving Vision-Linguistic Compositionality
  ☆16Updated 8 months ago
• wangf3014 / Patch_Scaling
  Official implementation of Scaling Laws in Patchification: An Image Is Worth 50,176 Tokens And More
  ☆23Updated 4 months ago
• yliu-cs / PiTe
  [ECCV'24 Oral] PiTe: Pixel-Temporal Alignment for Large Video-Language Model
  ☆16Updated 4 months ago
• AlenjandroWang / ASVR
  Autoregressive Semantic Visual Reconstruction Helps VLMs Understand Better
  ☆29Updated last week
• path2generalist / General-Level
  On Path to Multimodal Generalist: General-Level and General-Bench
  ☆14Updated last month
• Hon-Wong / ByteVideoLLM
  This is the official repo for ByteVideoLLM/Dynamic-VLM
  ☆20Updated 6 months ago
• Yaxin9Luo / Gamma-MOD
  [ICLR2025] γ -MOD: Mixture-of-Depth Adaptation for Multimodal Large Language Models
  ☆36Updated 4 months ago
• ali-vilab / alitok
  AliTok: Towards Sequence Modeling Alignment between Tokenizer and Autoregressive Model
  ☆29Updated this week
• Kevinz-code / SeVa
  [MM2024, oral] "Self-Supervised Visual Preference Alignment" https://arxiv.org/abs/2404.10501
  ☆55Updated 11 months ago
• MCR-PEFT / Ex-MCR
  ☆43Updated last month
• Qinying-Liu / TagAlign
  Official implementation of TagAlign
  ☆35Updated 6 months ago
• Optimization-AI / FastCLIP
  Distributed Optimization Infra for learning CLIP models
  ☆26Updated 8 months ago
• HarryHsing / EchoInk
  EchoInk-R1: Exploring Audio-Visual Reasoning in Multimodal LLMs via Reinforcement Learning [🔥The Exploration of R1 for General Audio-Vi…
  ☆36Updated last month
• ApexGen-X / MergeVQ
  [CVPR] MergeVQ: A Unified Framework for Visual Generation and Representation with Token Merging and Quantization
  ☆31Updated this week
• Gen-Verse / HermesFlow
  HermesFlow: Seamlessly Closing the Gap in Multimodal Understanding and Generation
  ☆63Updated 4 months ago
• adobe-research / ImageFolder
  ☆18Updated 6 months ago
• haoyi-duan / DG-SCT
  NeurIPS'2023 official implementation code
  ☆64Updated last year